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EDITORIAL 


Thoughts on Manuscript Citation Formats 
of DOI and ORCID 


Our journal has adopted Chicago Turabian and APA styles for accommodating 
citation formats used by scholars across library and information science, and 
humanities and social sciences. In our issues of recent years, it shows that scholars 
using APA style have outnumbered the ones using Chicago Turabian style, 
suggesting a shifting trend of studied topics in library and information science 
field. The newly published Public Manual of the American Psychological 
Association, 7th edition (2020), is a new edition since the sixth edition of ten years 
ago, with additions of Digital Object Identifier (DOI) and Open Researcher and 
Contributor Identifier (ORCID) in Author Note on title pages. In the former sixth 
edition of APA, a notable space was attributed to introduce syntactic structures 
and functions of DOI, and an announce was made to use DOI as the first priority 
choice for website addresses of electronic texts. In the present seventh edition, 
the adoption of DOI seems even more a matter of fact. In the other hand, the 
newest Chicago Turabian style is the ninth edition of year 2018, but early in the 
seventh edition of 2007, it had made clear DOI’s precedence. 

The reason for using DOI, not a regular URL, as website addresses, is 
to make sure that availability and accessibility of cited literature could be 
permanently maintained with an effective management and operation system. 
Thus through international authoritative citation formats and academic writing 
manuals, such as APA or Chicago Turabian styles, we can clearly see that DOI has 
outweighed others and become an international standard as the only manuscript 
identifier number system. Likewise, in the future the use of ORCID will also be a 
phenomenon in the international academic community. No matter whether we are 
now prepared or willing to accept these two identifier systems, DOI and ORCID 
will become necessary approaches for scholars to join the international academic 
community. 

In this issue (Issue 3, Volume 56), twelve manuscripts have gone through 
the review process. Four manuscripts have been accepted, with a rejection rate 
of 66.7%. The articles published in this issue include: “Using Visual Methods 
to Explore How Students in Information-Related Fields Express the Concept of 


999 


‘Information’” by Tien-I Tsai, “A Comparative Analysis of English Abstracts and 
Summaries of Chinese Research Articles Indexed by the Taiwan Social Science 


Citation Index: Arts Education, Sports & Exercise, and Management Journals 
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as Examples” by Min-Chun Ku, and “The Application of Quality Talks on the 
ePUB3 eBook-Based Flipped Design and Teaching of ‘Reading Comprehension’ 
Courses” by Tina Pingting Tsai, Chingsheng Hsu, and Jyhjong Lin, and 
“International Students’ Tutoring Experiences and Cultural Awareness in the 
Digital Learning Companion Project” by Sarah Otanga et al. It is worth noting 
that some articles in this issue have been published through the open peer review 
mode “Open Point” with author’s and reviewer’s reconsents to make part of peer 


reviews public. Special thanks are dedicated to the reviewer and author. 


Jeong-Yeou Chiu 
JoEMLS Chief Editor 


教育 资料 与 图 书馆 学 ”56 : 3 (2019) : 267-269 
DOL:10.6120/JoEMLS 201911. 56(3).editorial 


mE E 
DOISIORCID f£ HIIS iti AA XE Xa BU 


教育 资料 与 图 书馆 学 (本 刊 ) 向 来 控 用 又 引文 格式 (Chicago Turabian 与 
APA)’ 广泛 接纳 来 自 於 跨 图 资 学 领域 ， 且 分 属 人 文 社 会 学 科学 者 的 引文 格式 
EHRE -ERK > ATEH APA 格式 的 学 者 日 增 ， 玉 已 多 於 控 用 Turabian 格 
式 者 。 此 趋势 正 可 充分 说 明了 图 资 学 门 研究 主题 领域 的 授 杰 。 新 近 出 版 的 2020 
FE APA 格式 第 七 版 (Public Manual of the American Psychological Association, 7th 
edition ) 距离 第 六 版 已 相隔 10 年， 如 今 新 版 再 次 就 数位 物件 识别 码 (DOI); 
以 及 增 列 和 开放 的 研究 员 和 页 献 者 识 列 码 ,(ORCID ) 於 题名 页 (title page ) H5! 作 
ith) (Author Note ) fH » DOIMA * APA 第 六 版 以 极 明 显 篇 幅 介 厄 其 语 
法 结构 及 功能 ， 下 宣 告 优先 引用 DOI 码 ， 作 为 电子 文献 网 址 的 首选 ; 而 至 此 第 
七 版 ，DOI 的 探 用 更 局 平常 且 钳 於 成 熟 。 相 对 於 比 ，Chicago Turabian 引文 格式 
目前 最 新 版 本 为 2018 年 的 第 九 版 ， 其 实 Chicago Turabian 早 在 2007 年 第 七 版 即 
已 宣告 DOI 的 优先 性 。 

HR SLB ^ 优先 引用 DOI 而 非 一 般 URL 移 址 的 原因 ， 旋 在 於 确 保 在 
有 效 的 管理 管 运 制度 之 下 ， 使 被 引用 文献 的 可 得 性 (availability ) 与 可 及 性 
(accessibility ) ẸKA » AIE » 3538 APA BY Chicago Turabian 此 类 国际 权 
威 的 引文 格式 与 写作 规范 工具 书 ， PMB EREE T REDOI CAR IS BABS 
SEV ADE ^ E FR CE ado AE ^ [HIER ^ 未 来 ORCID 的 
JE Fd t. ye BEAR fa [e] EET BUE — Iria ZH ^ AN PR ECE A TB GE De Sca PI 
Tia LE. + DOLEE] ORCID 的 揉 用 都 将 成 为 学 者 们 唯一 的 国际 化 必要 手段 。 

此 卷 期 (56 卷 3 期 Wat 12 篇 稿件 完成 评阅 流程 ， 接 受 刊登 其 中 4 篇 文章 ， 
退 稿 率 鸭 66.7%。 本 卷 期 刊登 大 作 分 别 马 : Tien-I Tsai 的 “Using Visual Methods 
to Explore How Students in Information-Related Fields Express the Concept of 
‘Information’” > bj Min-Chun Ku 的 “A Comparative Analysis of English Abstracts 


and Summaries of Chinese Research Articles Indexed by the Taiwan Social Science 


Citation Index: Arts Education, Sports & Exercise, and Management Journals as 
Examples” ; 32280602 » TBE » MAB PERRY | 深度 讨论 应 用 於 ePUB3 电 
TESA ae TELA eat ETS 1 > Sarah Otanga 等 四 位 发 表 的 
“International Students’ Tutoring Experiences and Cultural Awareness in the Digital 
Learning Companion Project" ° Amba AAA [EDS EA PID pel PE 
Bal" BABGELES | (Open Point) 呈现 ， 特 以 向 审查 者 与 作者 致意 。 
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Abstract 


This study used a visual method to explore how 219 undergraduate and master’s 
students in library and information science, information management, and 
computer science perceive the concept of “information” through drawing and 
writing. Through content analysis, the researcher examined the elements and 
meanings appeared in the participant-drawn pictures, namely, the iSquares. 
The findings showed that while types of iSquares are somewhat similar among 
students from different fields of study, the elements used to express the concept 
of information are quite different. The complexity of the compositions and the 
perspectives are also different. Students in library and information science 
tend to use more complex compositions, and include the image of people 
and print materials as elements in their iSquares. They tend to use various 
metaphors to express the concept of information, and address issues related to 
uncertainty, information seeking process, or information hierarchy. In contrast, 
students in information management tend to address issues related to big data, 
and students in the computer science tend to present the concept of information 
with a relatively simple composition including tools and equipment. Based on 
the findings, the current study provides pedagogical and research suggestions. 


Keywords: Visual methods, Information science, College students, Information 


Introduction 

Individuals interact with information every day. Students in information- 
related fields not only interact with information for everyday-life purposes but 
also tackle the issues regarding information in their coursework and research. 
According to the list of departments in higher education from the Ministry of 
Education (2018), the major fields of study related to information include library 
and information science (LIS), information management (IM), and computer 
science (CS). Among them, the field of library and information science comes 
from the traditional library science with the development of science and 
technology, focusing on the creation, collection, organization, preservation, 
and dissemination of various information (Department and Graduate Institute 
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of Library and Information Science, National Taiwan University, n.d.; Hu & 
Wang, 2003; Lai, 2001); the field of information management has evolved with 
the development of science and technology, mainly focusing on the application 
of information systems to assist management, as well as the management of 
information systems (Department of Information Management, National Taiwan 
University, n.d.); the field of computer science focuses on development and 
application of information technology (Department of Computer Science and 
Information Engineering, National Taiwan University, n.d.). 

Although students and scholars in all these disciplines study "information", 
they may study information from very different perspectives. Navigating 
through fundamental textbooks and syllabi of information-related fields (National 
Taiwan University, n.d.), the concept of information is mostly briefly discussed. 
Despite that library and information science courses may spend a unit on the 
topic of "information", information management and computer science courses 
typically dive into the structure or the application of information. Examining 
how students in the above three fields view "information" may not only help us 
better understand perceptions of students’ with different types of training but also 
illustrate the concept of information in fuller ranges. 

"iSquare" developed by Hartel since 2011 (Hartel, n.d.) is a visual method 
to study how people perceive the concept of information; it is, at the same time, a 
pedagogy to help instructors address this concept. Hartel (2014a, 2014b) used this 
draw-and-write technique asking students to express the concept of "information" 
through drawing on a small square blank paper with a brief textual description on 
the back side of the paper; these studies discussed images based on Engelhardt's 
(2002) types of graphic presentations and analyzed information behavior 
concepts appearing when students present the concept of information. More 
recently, Hartel tried to examine iSquares with different data analysis methods. 
Hartel (2015, 2017) proposed four methods for analyzing iSquares; Hartel and 
Savolainen (2016) discussed iSquares with pictorial metaphor analysis. Hartel 
et al. (2018) discussed the implementation of iSquares and proposed specific 
data collection and analysis methods for iSquares research. This draw-and- 
write technique has also been applied to different cultural settings (e.g., Ibekwe- 
SanJuan, 2017; Tsai, 2015) and used to explore other concepts (e.g., Ibekwe- 
SanJuan, 2018). 

iSquare research is growing but still in its developing stages. Based on 
Hartel (20142), Tsai (2015) attempted to use this visual method to explore the 
information stories of 56 LIS students. The study used thematic analysis to 
examine the elements appeared (e.g., image of people, media and tools, the nature 
and other contextual elements) and the concepts presented. on iSquares. (such as 


Tsai: Using Visual Methods to Explore How Students in Information-Related Fields Express the Concept of “Information” — 273 


information theory and the concept of information behavior, the characteristics of 
huge amounts of data); based on the themes appearing in the iSquares, stories of 
information were illustrated in four different ways: 1. from micro-social to macro- 
social/from imperceptibly small to vast, as suggested by Hartel (2014a); 2. from 
concrete descriptions to abstract metaphors/from external to internal; 3. from static 
to mobile/from trickling to rapid; 4. from unorganized to organized/uncertain to 
confident. The current study aims to extend relevant studies and examine how 
students in information-related fields perceive the concept of information through 
drawing and writing on the iSquares, as well as how similar or different their 
iSquares are. The research questions include: 
1. How do students in information-related fields express the concept of 
"information" through drawing and writing? 
2.How similar or different are the elements used in students' iSquares 
across information-related fields? And how similar or different are their 
perspectives? 


Literature Review 
In order to delineate how to approach the fundamental question of “what 
is information" through iSquare as a visual method, the literature review starts 
from defining the concept of information based on dictionaries and textbooks in 
information-related fields, followed by iSquare as a visual method and the current 
state of relevant empirical studies in the field of LIS. 


Defining the Concept of Information 

Information is a common vocabulary in our daily lives, but it is one that “being 
used widely but inaccurately" (Wang & Hsieh, 2014, p. 5). According to Wang 
and Hsieh, information is a collection of statements, opinions, facts, concepts, or 
ideas between the raw data and knowledge; it can be any processed data and is 
often obtained through communication, research, teaching, observation, and so on. 
Tsai (2015) also pointed out that most dictionaries do not distinguish the concepts 
of data, information, and knowledge, and define information in a simple but 
general way, except for a few emphasizes that information need to be processed 
or helpful to individuals. For instance, Longman Dictionary of Contemporary 
English and Cambridge Dictionary focus more on the factual information; Collins 
English Dictionary, Merriam-Webster Dictionary, and Oxford English Dictionary 
emphasize knowledge learned and experienced (Information, n.d.-a, n.d.-b, n.d.-c, 
n.d.-d, n.d.-e). 

Interestingly, when investigating the definition of information from the 
textbooks of information-related fields, we can easily see different emphases in 
the three information-related fields. Many LIS textbooks, introduce the, DIKW 
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hierarchy when defining information, and the textbooks also discuss different 
perspectives of information (e.g., Lai, 2001; Wang & Hsieh, 2014). Some 
also introduce Buckland’s (1991) perspectives when discussing the nature of 
information — information as process, information as knowledge, and information 
as thing, and distinguish the idea of tangible versus intangible, entity versus 
process (e.g., Lai, 2001). Buckland's information-as-process focuses on the 
intangible process of cognitive change, or the process of messages delivering 
through physical items such as books or documents. Information-as-process 
focuses on the intangible process of cognitive change, or the process of messages 
delivering through physical items such as books or documents. Information-as- 
knowledge focuses on the intangible nature of information, emphasizing what 
information intellectually giving to people. Information-as-thing focuses on 
the tangible nature of information, emphasizing the physical object itself such 
as books or documents. Other LIS textbooks also discuss information from 
a viewpoint of communication by introducing Shannon and Weaver's (1949) 
classic work, emphasizing that messages are delivered from a sender to a receiver 
through a certain channel (e.g., Bawden & Robinson, 2013; Debons, 2008; Lai, 
2001). 

On the contrary, IM and CS textbooks typically spend much less emphasis on 
introducing the concept of information. Several IM textbooks define information 
as meaningful and useful messages that are transformed or processed from data 
(Chu, 2017; Laudon & Laudon, 2018; Long, 2003). These textbooks tend to 
emphasize the linear procedure turning raw data into meaningful information with 
a few sentences to make this simple distinguish, and focus more on information 
systems and information technologies while introducing the basic concepts of 
information management. Others do not provide formal definitions or discussions 
regarding the concept of information (e.g., Hsieh & Wu, 2009; Lin, 2010; Wu, 
2015). In CS textbooks, they typically don't formally define information and 
dive into concepts regarding data type, data structure, algorithm, hardware, 
and so on (e.g., Cormen, Leiserson, Rivest, & Stein, 2009; Karumanchi, 2017). 
These different emphases may help us better understand students’ perceptions on 
information later in the discussion section. 


Visual Methods and iSquare Research 

Visual methods can be all uses of images for research, with or without 
accompanying words and whether pre-existing or generated as part of the research 
process (Payne & Payne, 2004). The images can either be pictures, photographs, 
video, or film, etc., and a simple classification can be made based on the source 
of images— 1. images produced by the researcher, and 2. images produced or 
found by the participants (Jupp, 2006). According to Jupp, visual methods offer 


Tsai: Using Visual Methods to Explore How Students in Information-Related Fields Express the Concept of “Information” — 275 


the knowledge that cannot be communicated verbally or in written words, and add 
a new dimension to qualitative research. Research that employs visual methods 
relies on collecting and analyzing visual data such as drawings, photos, videos, 
films, and visual arts (Banks, 2001, 2007; Spencer, 2011). When using visual 
methods to explore a specific concept, participant-draw pictures are often used; 
this approach has been used a lot on school children and can also be applied 
to different populations ranging from college students, adults, and the elderly 
(Copeland & Agosto, 2012). 

In the field of LIS, an increasing number of studies have been applying 
in many different ways recently (Hicks & Lloyd, 2018). Hicks and Lloyd also 
pointed out that applying visual methods can help to bring up more in-depth 
discussions in the field. Compared to other fields in social sciences, the use and 
development of visual methods in LIS research happened relatively late. It is 
not until the recent decade that visual methods received attention, and Hartel’s 
iSquares can be seen as one of the important recent starts of using visual methods 
in LIS research. 

In 2011, Hartel developed iSquares as a pedagogical approach and a research 
approach to explore how students perceive the concept of information (Hartel, n.d.). 
It is a visual method with participant-drawn images with texts but without verbal 
narratives (Hartel, 2014a). Hartel (2014a) used this draw-and-write technique 
to explore the same question—what is information—with 137 iSchool graduate 
students and examined each iSquare and categorized them with different types of 
graphic representation based on Engelhardt (2002). Hartel found these iSquares 
were composed mainly in picture, link diagram, and grouping diagram. Hartel 
(2014b) then focused on the information behavior concept addressed in 293 
iSquares from graduate students in information and museum studies. Through 
deductive theme analysis, Hartel (2014b) examined information behavior concepts 
appearing in the iSquares, and found that print artifacts, information technologies, 
abstractions and patterns, symbols, and the nature were used to express the idea. 
Images of people were presented through hands, the brain, a person thinking, a 
twosome in information exchange, and an information-rich social world. 

Tsai (2015) attempted to explore students’ perceptions of information 
through iSquares with 56 LIS students. The study used thematic analysis 
to examine the elements appearing in the iSquares and identified three main 
categories: 1. Image of people, 2. media and tools, 3. the-nature and contextual 
elements. Meanwhile, the perspectives based on Buckland’s (1991) views. of 
information and the concept of information behavior, as well as characteristics 
of big data (ie., volume, velocity, and variety) were also identified.to form four 
different versions of information stories. 
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More recently, Hartel (2015) proposed four methods for analyzing iSquares, 
including compositional interpretation, thematic analysis, content analysis, and 
pictorial metaphor analysis. However, it is a brief conference abstract without 
details. Hartel and Savolainen (2016) further discussed the concept of information 
using iSquares with pictorial metaphor analysis, and found iSchool students used 
a wide variety of elements in the metaphor—the earth, net, tree, light bulb, box/ 
box, cloud, seed, sun, ocean/boat, fishing/mining. Hartel (2017) then developed 
the iSquare protocol with its detailed procedure, and reiterate the four data 
analysis methods for iSquare research. Specifically, an example of ongoing 
International iSquare research with content analysis was introduced. The coding 
scheme were also introduced, and items in the coding scheme included print 
artifacts, information behavior, ICTs, information structures and organizations, 
and the settings. 

Overall, iSquare research using participant-drawn images as a visual 
method has been mostly conducted with students in LIS/iSchool. While different 
data analysis methods have been applied in empirical research for different 
purposes, on-going content analysis iSquare research seemed to be still underway 
and require further endeavors to expand iSquare research. The current study 
developed a codebook for content analysis based on the above literature so that 
iSquares from students with different backgrounds can be easily compared. 


Methods 


The purpose of the current study is to examine how students perceive 
the concept of “information” through drawing and writing. An arts-informed 
qualitative method was used to collect data. In order to systematically compare 
and contrast students’ perceptions across three information-related fields, content 
analysis was used to analyze the data. 


Data Collection 

The current study used a visual method—iSquares—to explore the concept 
of information perceived by 219 undergraduate and graduate students from the 
Department of Library and Information Science, Information Management, and 
Computer Science & Information Engineering at a large public research university 
in Northern Taiwan. With instructors’ permissions, students were recruited 
from a required course from each department. As suggested by. Hartel, the best 
occasion for an iSquare activity is in classroom settings. Therefore, the researcher 
scheduled a time with the instructors and collected the iSquares in the above 
courses. 

This study follows Hartel’s (2014a) iSquare protocol and used iSquare as 
the research instrument. A 4.25 square-inch white drawing paper with one blank 
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side and the other printed instructions. Students were briefly introduced with the 
research, and then asked to use approximately ten minutes to draw on the blank 
side and describe their drawings with texts, as well as answer the demographic 
questions, including gender, age, and program, on the reverse side. To ensure 
the reliability of the current study, the researcher also provided black pens to the 
students with the iSquare paper. The researcher finally concluded the activity and 
finished the data collection procedure. Additionally, the researcher also kept field 
notes for each iSquare activity for each course. 


Participants 

Students who participated in the current study included 138 undergraduate 
and 81 graduate students from the Department of Library and Information 
Science (31.05%), Information Management (33.33%), and Computer Science 
& Information Engineering (35.62%; see Table 1). While most LIS students are 
female (80.696), more IM students are male (66.796), and CS students are mostly 
male (86.5%). The gender distribution roughly reflects the student population in 
each department. As to the age, almost all students are between 19 and 25 (93.61%) 
with an average of 21.67 (SD = 2.98). 


Table 1 Participants’ Demographics (N= 219) 
Demographics Number of participants Percentage (96) 
Gender Male 125 57.08 
Female 88 40.18 
Choose not to identify 6 2.74 
Age 19-20 103 47.03 
21-22 54 24.66 
23-25 47 21.46 
Over 25 12 5.48 
Blank 2 91 
Field of Study Library and Information 68 31.05 
Science (LIS) 
Information Management (IM) 73 33.33 
Computer Science (CS) 78 35.62 
Level of Study Undergraduate 138 63.01 
Graduate (Master's level) 81 36.99 


Data Analysis 

Content analysis is a systematic approach, which aims to analyze the content 
characteristics of data quantitatively, and to some extent, can reach inferences 
beyond descriptive analysis (Neuendorf, 2002). It can systematically examine 
and compare the contents appearing in visual data (Rose, 2007), including 
iSquares (e.g., Hartel, 2015, 2017). The purpose of this study is to explore 
how students in information-related fields perceive and present the- concept of 
“information”. Through content analysis, iSquares from the three departments 
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can be systematically compared and contrast. While data analysis was conducted 
mainly based on the drawings, supplemented by text, the unit of analysis is the 
iSquare by each student. All information on each iSquare (both drawings and 
texts) by each student was viewed as one unit. 

The codebook of the current study was developed mainly based on 
previous studies (Hartel, 2014b; Tsai, 2015) and the International iSquare Study 
(http://www. isquares .info/international-isquare-study.html). In addition to the 
demographics (i.e., gender, age, program, degree), the codebook with 25 questions 
was divided into two major parts: 1. composition and elements; 2. perspectives 
and meanings of the information concept. Regarding the composition, basic types 
of graphic presentations are based on the ten categories proposed by Engelhardt 
(2002), and other composition and element questions came from the International 
iSquare Study and Hartel (2017); the perspectives and meanings are mainly 
derived from the findings of Tsai (2015) and the International Study. 

As to the graphic presentation, each iSquare was categorized into one 
specific graphic presentation (e.g., picture, link diagram, or grouping diagram) 
according to its major composition. If the iSquare drawing contains multiple 
graphic presentations (such as groups, links and texts), the texts on the other 
side of the iSquare would be used to help identify the major composition. 
Figure 1 presents the iSquares that were identified as the three major graphic 
presentations — pictures, link diagrams and grouping diagrams. 


Pictures Link diagrams Grouping diagrams 


^ 


A ! 


Figure 1 Three Major Types of iSquare Graphic Presentations 


According to Tsai (2015), three major elements appearing in LIS students’ 
iSquares include: 1. the image of people, 2. media and tools, 3. the nature and 
other contextual elements. In order to be more specific to develop the codebook 
for content analysis, the current study used "information and communications 
technology (ICT)" and “print materials/artifacts" instead of “media and tools". 
And used "scenes" instead of “the nature and other contextual elements". When 
coding the elements in the iSquares, the researcher looked into the drawing to 
identify the aforementioned elements, and then consult the texts on the other side 
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to make sure it was accurately interpreted. When coding the perspectives and 
meanings of the information concept, the researcher relied even more on the texts 
to ensure not over interpreting the iSquares. 

The study codebook has undergone three major revisions and several minor 
adjustments. During the three revisions, approximately 5%, 8%, and 10% of 
total iSquares (i.e., 12, 18, and 21 iSquares) were sampled for codebook testing. 
Testing samples were evenly distributed from each discipline (i.e., 4, 6, 7 each). 
The researcher and two other coders with LIS background conducted the pre-tests. 
According to Kassarjian (1977), the ideal inter-coder reliability should be greater 
than 8596. The inter-coder reliability of current study increases from the initial 
83% to 92%. Chi-square tests were conducted for each item to see whether or not 
students from different disciplines present their iSquares differently. 


Findings 
The iSquares collected in the current study were analyzed based on their 
compositions, elements, perspectives and meanings, as described in the Methods 
section. Findings regarding how similar or different regarding the elements 
appearing in the iSquares and the perspectives and meanings are described as 
follows: 


Compositions of the iSquares 

The current study examined the type and complexity of the compositions of 
the iSquares across disciplines. No significant difference was found in the type 
of iSquares. Students in all information-related fields typically used pictures or 
link diagrams to depict the concept of information, and some used either grouping 
diagrams or written texts (Table 2). Nevertheless, the complexity of iSquares 
created by students in different fields are very different (4, N = 219) = 42.786, 
p < 001]. 


Table2 Composition of iSquares across 
Information-Related Fields 


Composition Field of study Distribution 
Type LIS Picture = Link Diagram > Grouping 
Diagram > Written Text > Symbol” 
IM Picture > Link Diagram > Written Text > 
Grouping Diagram > Symbol = Blank 
CS Picture > Link Diagram > Written Text > 
Grouping Diagram > Symbol > Blank 
Complexity ” LIS High = Medium > Low 


IM Medium > Low > High 
CS Low > Medium > High 


ee 
p< .001. 
Note: LIS represents library and information science; 
IM represents information management; 
CS represents computer science; "ho blank iSquare. 
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As to the types of iSquares, most students used pictures (43.8%) or link 
diagrams (28.8%) as the main composition. While Tsai (2015) and Hartel (2014a) 
were conducted only with students in the department of LIS and iSchool, the 
overall distribution in the current study is somewhat similar to the findings of Tsai 
(2015) and Hartel (2014a; see Table 3). The majority of the students used either 
pictures or link diagrams to present the iSquares. LIS students in the current 
study especially liked to use link diagrams; IM and CS students seemed to prefer 
written texts. 


Table 3 Type of iSquares in the Current 
Study and Relevant Studies (all in %) 


All students in LIS students in LIS undergraduate iSchool graduate 
Type of iSquares current study current study students in Tsai students in Hartel 


(N = 219) (n = 68) (2015) (N= 56) (2014a) (N = 137) 
Picture 43.8 39.7 50 52 
Link diagram 28.8 39.7 23 24 
Written text 14.2 74 9 6 
Grouping diagram 9.1 10.3 11 7 
Symbol 3.2 29 4 7 
Blank 0.9 0 0 2 
Table 0 0 0 2 
Total 100.0 100.0 100 100 


Although no significant difference was found in types of iSquares across 
disciplines, IM and CS students shared some similarity, whereas LIS students 
are unique among the three groups of students. For instance, the percentages of 
students who used written texts doubled those who used grouping diagrams in 
both IM and CS (IM 13.7% written texts vs. 6.8% grouping diagrams; CS 20.5% 
vs. 10.3%). There are also a few valid blank iSquares (with a textual explanation 
on the back side of their iSquares) from IM and CS students. In contrast, more 
LIS students (39.7%) than other students (IM 24.7%, CS 23.1%) used link 
diagrams, and grouping diagrams (10.3%) appeared more than written texts (7.4%) 
among LIS students. And no LIS students left their iSquares blank. 

When examining complexity by the ink ratio and the density of elements 
based on the 3 by 3 grids for each iSquare, there were more mid-level (44.896) 
than low-level ones (30.1%), and only a quarter (25.1%) were identified as 
high-level ones. However, LIS students tended to use much more complex 
compositions than other students, and CS students tended to compose their 
iSquares in a relatively simple way [x°(4, N = 219) = 427786, p < .001]. 
Specifically, nearly half of LIS students' iSquares (47.196) were identified as 
highly complicated, and another half were mid-level. In contrast, nearly half of 
IM students’ iSquares (49.3%) were mid-level, and about one-third (32.9%) were 
of low complexity. And most CS students’ iSquares (48.7%), were low or mid- 
level in complexity (38.5%). See Table 2 and Table 4. 
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Table 4 Complexity of iSquares across Disciplines 


Number of Percentage LIS (960 IM(%) | CS (96) 
Complexity participants (96) (n=68) (n273) (nz78) 
(N= 


219) 
Low 66 301 5.8 32.9 48.7 
Medium 98 448 471 49.3 38.5 
High 55 251 471 17.8 12.8 


Elements in the iSquares 

As to the elements students included in their iSquares, representation 
elements (e.g., texts, symbols), and conceptual elements (mostly as identified in 
Tsai, 2015) were examined. 

Representative elements in the iSquares 

Most students include some types of representative elements (such as texts, 
symbols, or lines) in their iSquares (86.8%). Among which, about half used texts 
(53.496) or arrows/lines (50.296), and about 3096 used symbols or punctuations 
(30.6%). A quarter used geometric shapes (24.2%). Other representation 
elements include: tables or charts (15.5%), labyrinth/maze-like lines (12.8%), 
binary expressions or programming languages (10.5%), speech bubbles (10.5%), 
thought bubbles (9.1%). A few students included specific social networks with 
connected people (6.4%) or specific brand names or logos (e.g., Google, Yahoo, 
Apple, Microsoft; 4.696), music notations/notes (3.296), or specific textbook 
names or subjects (1.4%). 

When further investigate the iSquares from students across fields of study, 
LIS students tended to include more lines or arrows [64.7%; XQ, N=219) 28.733, 
p < 05], dialog boxes [20.6%; XQ, N = 219) = 11.441, p < 01] and thought 
bubbles [16.2%; 7(2, N = 219) = 6.766, p < .05] in their iSquares; IM and CS 
students tended to include binary codes (0101) or any expressions of programming 
languages [20.5%; XQ, N = 219) = 14.622, p = 001] in their iSquares. Some IM 
and CS students also included dollar signs or other representation of money; others 
used commercial brands, icons or logos to represent “information” (Figure 2). 

Conceptual elements in the iSquares 

As shown in Table 5, nearly half of the students included the image of people 
(47.096) and more than a quarter included some kind of ICT tools (27.996). About 
one-fifth included print materials or artifacts (19.296), and few included. a scene 
(8.7%). Comparing to non-LIS counterparts, LIS students tended to express the 
image of people Dx^Q, N= 219) = 17.460, p < .001] and print materials IQ, N= 
219) = 11.121, p < 01]. Regardless of disciplines, few students include elements 
that show the settings in their iSquares, so no significant difference was found 
regarding scenes. 
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Figure2 Sample iSquares of Representation Elements 
by Students in Information-Related Fields 
Note: 1. LIS represents library and information science; IM represents information 
management; CS represents computer science. 2. No money signs or similar elements 


appeared in LIS students’ iSquares; while a few LIS students used characters for metaphor 
(see Figure 7), no standalone iconic element appeared in LIS students’ iSquares. 
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Table 5 Conceptual Elements in Students’ iSquares 


Conceptual elements Number of Percentage LIS(%) IM(%) CS(%) 
participants (%) (n=68) (n=73) (n=78) 
(N= 219) 
The image of people 103 47.0 67.6 41.1 34.6 
ICT 61 27.9 324 24.7 269 
Print Materials and Artifacts” 42 19.2 32.4 123 14.1 
Scenes 19 8.7 103 11.0 8.7 


"p < 01; "p < 001. 

As to the image of people, students used people, body parts to present this 
idea (Figure 3). Two-thirds of LIS students (67.6%) used people’s faces or brains 
to present the image of people; only less than a half of IM students (41.1%) and 
one-third of CS students (34.6%) present the image of people. Regardless of 
students’ field of study, half of those who included the image of people presented 
“thinking” or “human interactions,” and LIS students especially tended to present 
the idea of “thinking”. LIS students also tended to present “both human and 
documents” or “both human and non-human sources”. Very few IM and CS 


LIS IM CS 


Figure 3 Sample iSquares of ICT and Print Materials 
by Students in Information-Related Fields 
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students presented “both human and documents” (four each) or “both human 
and non-human sources” (four and two each). Most CS students who presented 
human beings also presented a computer and/or other tools (e.g., Figure 3 CS-2). 
In general, LIS students included more diverse sources. Even when talking about 
technology, more LIS students (29.4%) than other students (11.3%) included “both 
human and technology” in their iSquares. 

When investigating the ICT appeared in the iSquares, about 70% of students 
included computers, laptops, or other mobile devices in their iSquares. However, 
IM and CS students tended to include mobile devices (non-LIS 35.1% vs. LIS 
4.5%), the Internet or websites (non-LIS 32.4% vs. LIS 18.2%), and other 
electronic equipment such as the server (non-LIS 21.6% vs. LIS 9.1%). LIS 
students tended to include traditional media such as television and radio (LIS 
27.3% vs. non-LIS 16.2%). About one-third of LIS students (33.8%) included 
print materials such as books, documents or magazines; only a few of non-LIS 
students did so (IM 12.3%, CS 14.1%). And it is interesting that all non-LIS 
students who include print materials also include computers, laptops, or mobile 
devices (Figure 4). 

As to the few iSquares included a scene or a setting, most LIS students who 
included a scene presented the nature such as mountains, lakes, trees, and most CS 
students presented office settings. Half of the IM students who included a scene 
presented the nature, and the other half presented office settings. It is interesting 
that this may somehow reflect the nature of disciplines. LIS students tended to be 
more towards the humanities and used a metaphor to present the scene. Whereas, 
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Figure 4 Sample iSquares of ICT and Print Materials 
by Students in Information-Related Fields 
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CS students tended to be more towards the sciences and thus used physical 
space and equipment to present the “real” scene. And IM students seem to be in 
between exhibiting both ways of presenting the scene. 


Perspectives and Meanings of the iSquares 

When using Buckland’s (1991) perspectives on information to discuss 
iSquares, about a quarter of students (25.1%) presented their iSquares from the 
perspective of information-as-process (Figure 5); only 10.5% presented from the 
perspective of information-as-knowledge (Figure 6). While many students used 
things to express information sources, 42.9% of the students used metaphor to 
present the iSquares. Since the previous section presented the findings regarding 
information sources, the following discussion on information-as-thing will focus 
on how students used “things” to do the metaphor (Figure 7). 
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Figure5 Sample iSquares of Information-as-Process 
by Students in Information-Related Fields 


Note: The iSquares selected in Figure 5 emphasized a specific process 
from an individual's perspective (e.g., information seeking) or 
from a functional perspective (e.g., information transformation). 


Information as process 

About one-third of LIS (33.8%) and IM students (32.9%), as well as 10.3% 
of CS students, presented the process Ke2, N = 219) = 14.237, p= 001; Figure.5]. 
Among which, most students (65.5%) describe the concept of information in a 
linear process, others (21.8%) describe a hybrid or complicated process, and few 
(14.5%) mentioned a circular process. These iSquares mostly implied information 
seeking processes or information transformation processes. 
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We can also find differences across disciplines when further examining the 
processes with the concept of information seeking. Only LIS students (19.1%) 
explicitly express information seeking. And while one-third of LIS students 
mentioned uncertainty (32.4%), only 13.7% of IM students and 6.4% of CS 
students mentioned this idea (x [2, N = 219] = 18211, p < .001). Among students 
who mentioned uncertainty, most of them included question marks or used texts 
to propose a question (70.396); a few students used multiple options to present 
uncertainty (16.2%). And only LIS students (21.7% of those who expressed 
uncertainty) used a "gap" to present the idea of uncertainty. LIS students 
expressing uncertainty could come from textbook such as Case and Given (2016) 
who introduced Brenda Dervin's sense-making metaphor in the context of 
information seeking and information use. 

Information as knowledge 

Within the few students (10.596) taking about information-as-knowledge, 
they typically discuss the concept of information with one of the relevant concepts 
in the data-information-knowledge-wisdom (DIKW) hierarchy (Table 6; Figure 6). 


Table 6 iSquares Presented the DIKW Hierarchy 


Hierarchy Number of participants Percentage 
(n= 23) (%) 
Data—Information 16 69.6 
Information— Knowledge/Wisdom 6 26.1 
Multiple Levels (D-I-K-W) 1 43 
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Figure 6 Sample iSquares of Information-as-Knowledge 
by Students in Information-Related Fields 
Note: The iSquares selected in Figure 6 focused on specific concepts 
in the D-I-K-W hierarchy. However, no CS, students presented 
information-as-knowledge through their iSquare drawings. 
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Some also implied "information as process" with the emphasis on information 
transformation. However, students from different field of studies tended to 
use different ways of presenting information as knowledge Gp, N=219] = 
7.386, p < 05). While LIS students (17.6%) tended to discuss multiple levels 
(however mostly shown in texts) or the higher level of how to turn information 
into knowledge, IM students (11.096) tended to discuss the lower level regarding 
turning data into information. Very few CS students (3.8%) mentioned turning 
data to information only in texts, and thus no iSquare drawings by CS students 
present information as knowledge explicitly. 

Information as thing 

In addition to using things (e.g., mobile devices, documents) to present 
information sources as identified in the previous section, when viewing 
information as thing, students also used a metaphor to explain the idea of 
information. While nearly half of the students (49.3%) used metaphors to 
present the concept of information, students from different field of studies exhibit 
different in the use of metaphor. Most LIS (57.4%) and IM students (56.2%) used 
metaphors in their iSquares, but only slightly over one-third of CS students (35.9%) 
did so (x [2, N = 219] = 8.746, p < .05). 

Students used over 30 different things to imply the concept of information 
(Figure 7), including the image of people (e.g., brains, eyes, hands, ears, hearts), 
animals (e.g., birds, fish, insects, spiders), plants (e.g., trees, flowers, sprouts), the 


LIS IM CS 


Figure 7 Sample iSquares of Information-as-Thing 
by Students in Information-Related Fields 


Note: iSquares selected in Figure 7 used specific 
things (e.g., the lightbulb) for the metaphor. 


288 Journal of Educational Media & Library Sciences 56 : 3 (2019) 


nature (e.g., sun, moon, stars, clouds, the earth/globe, rocks/stones), buildings/ 
roads/bridges, tools and items (e.g., light bulbs, glasses, containers/bottles/cups, 
musical instruments, transportation, weapons, keys, screwdrivers), money (e.g., 
coins, banknotes, dollar signs), and food (e.g., cakes, vegetables, fruits). Despite 
similar metaphors such as clouds (14.9%) and light bulbs (13.8%), only LIS 
students used bridges (3.0%), and only IM and CS students used money (13.1%), 
transportation such as airplanes, cars, bikes (13.1%), and weapons such as swords, 
guns (1.6%). Interestingly, a few LIS students used characters in animation or 
games to do the metaphor. For instance, one used Doraemon who owns a magic 
four-dimensional pocket, and one used Mario who can be powered up by the 
super mushroom. No matter what was used for the metaphor, students typically 
used positive implications to present their ideas about information. 

Although students in the current study used some similar metaphors (e.g., 
lightbulbs, clouds) with what were presented in Hartel and Savolainen (2016), the 
LIS students in the current study seemed to use a wider range of “things” to do the 
metaphor. 

Big Data Perspectives 

When examining iSquares with the 3Vs concepts of big data— volume, 
velocity, and variety, 48 students who mentioned one or two big data concepts 
mainly came from non-LIS fields (7096), including 31.596 of IM students CAVA 
N = 219] = 6.776, p < .05). Most of them mentioned the great volume of big data 

LIS IM CS 


Figure 8 Sample iSquares of Big Data by Students 
in Information-Related Fields 


Note: iSquares selected in Figure 8 highlighted the, 3Vs 
concepts of big data—volume, velocity, and/or variety. 
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(77%), some mentioned the variety of information (27.1%), only a few mentioned 
the velocity (16.7%), and only one LIS student mentioned the velocity. See 
Figure 8. 

Discussion 

Although the current study focus on students from different disciplines 
perceive the concept of information, the researcher also examined the effects from 
the level of study (undergraduate or graduate levels) in order to draw conclusions. 
The only differences between undergraduate and graduate students were found 
in using texts and metaphor, and expressing the ideas of uncertainty. Graduate 
students tended to use more texts, less metaphor, and express uncertainty. No 
significant differences were found in all the other elements or perspectives. 
Therefore, the following discussion focuses simply on how students from different 
fields of study express the concept of information in their iSquares. 

LIS students tended to use link diagram with more complex compositions. 
Therefore, they use more arrows and lines than other students. And the 
representation elements included in LIS students’ iSquares are also more diverse 
than other students. For instance, more LIS students than others used speech 
bubbles and thought bubbles. And resulting from the nature of the field of study 
as well as the different courses in each program, more IM and CS students than 
LIS students included binary codes or expressions of programming languages. 

The different use of representation elements across disciplines could 
possibly be explained by the differences in students’ compositions. And students’ 
compositions somewhat reflect the nature and approaches of different disciplines. 
Among the three fields of study, LIS is the one closest to social sciences and 
humanities, and CS is on the hard-science end. Whereas, IM located in between. 
LIS students are trained with social science approaches, so they typically 
tackle issues with contexts; CS students are typically trained to find effective 
solutions to solve problems. Therefore, when answering a question like “what 
is information?” LIS students tend to include more elements to provide contexts 
or disclose different perspectives, and CS students tend to find a simple and 
elegant way to “answer” it. This phenomenon can not only be seen from their 
drawings but also from their texts. For instance, LIS students typically use a 
longer paragraph to describe what they perceive as information and explain their 
drawings; some CS (n = 9) and IM students (n = 4) consider information as the 
binary codes — "information is the combination of 0 and 了 is created through 0 
and 1/is typically binary 0 and 1/is constructed by 0’s and 1’s:” Among which, one 
CS students even stated that “information is nothing more than 0 and 1.” 

Textbooks reflect the nature of the three information-related fields, and 
these can probably further explain the differences in the;conceptual elements and 
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perspectives appeared in the iSquares. LIS students tended to include people 
with a wider range of sources that carry information since various areas in LIS 
textbooks typically introduce communication theories or information behavior 
theories that emphasize information channels and different sources of information, 
and when discussing information services, user-centered design is always one of 
the major concerns. And what IM and CS students learned is typically based on 
certain software, hardware, so they may naturally focus on the ICT devices. 

Additionally, since many LIS textbooks introduce the DIKW hierarchy 
when defining information (e.g., Lai, 2001; Wang & Hsieh, 2014), students are 
more likely to mention multiple levels or emphasized how to turn information 
into knowledge. Since IM textbooks typically define information as meaningful 
messages processed from data (Chu, 2017; Laudon & Laudon, 2018), students 
tended to emphasized the lower level of the DIKW hierarchy. Since CS textbooks 
tend to introduce data structure, algorithm, etc. without formally defining 
information (e.g., Cormen et al., 2009; Karumanchi, 2017), students tended to use 
what they learn and practice—usually things related to coding—to express the 
concept of information. 

Another interesting thing in the same vein is that the use of icons or 
commercial brands also reflect the different nature of the three fields. On the 
more humanities end, LIS students used brand characters to do the metaphor; on 
the social science end, a few LIS students used commercial icons as one of the 
many media or sources that carry information. Unlike LIS students, some IM 
and CS students used one single icon that represents an information product or a 
specific program to express the concept of information. This well presented what 
information engineering might rely on because things would not functions without 
hardware or infrastructure, and certain information product or program may play 
an important role. 


Conclusion 

Despite that the distribution of iSquare image types is somewhat similar 
among students from different fields, the complexity of elements used to 
express the concept of information is significantly different. The perspectives 
of how students express “information” are also quite different. In the field of 
LIS, students tend to use more complex compositions and metaphor to express 
"information" and include people or image of people, print documents in their 
drawings. They also tend to express the concept of uncertainty, information- 
seeking processes, and the DIKW hierarchy. In contrast, IM students tend to 
express the concept of big data, and CS students tend to include. computers, 
equipment, and/or concepts related to programming to express "information". 
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In general, students in different fields did use different elements and 
exhibit quite different perspectives on information. The way instructors address 
the concept of information may affect how students tackle issues regarding 
information, and thus shape the field in the future. If instructors in information- 
related fields are open to introduce the concept of information in fuller ranges, it 
can help students better understand how to position their own field of study among 
information-related fields. The current study provide insights for instructors to 
reflect on how they might want to address the concept of information. 

As to future research, based on findings of the current study and Hartel 
(2014b), many students included the image of people in their iSquares and implies 
the concepts of information behavior. It would be interesting to further investigate 
how students’ perceptions on information affect their own information behavior. 
This also helps iSquares evolved into a visual elicitation method. 

Although Buckland’s (1991) perspectives on information served as a solid 
foundation for the content analysis of iSquares, some of the iSquares in the current 
study cannot be categorized in one of the three perspectives by Buckland. This 
implies that iSquares research can help further expand our discussions regarding 
the concept of information. And while the current study provide a coding 
scheme for iSquare content analysis, future studies can further develop specific 
items in the codebook based on the current coding scheme regarding iSquares’ 
composition, representation elements, conceptual elements, and perspectives/ 
meanings. Since participants’ drawings vary from context to context, researchers 
can always start with open coding before finalizing the codebook of the content 
analysis. Future studies can also conduct longitudinal studies comparing 
individuals’ iSquares in order to capture individual’s perspectives on the concept 
of information in ever-changing information practices. 
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本 研究 运用 资讯 方块 ] uu e ， 以 受 试 者 所 
产 诬 的 图 文 ， 探 讨 来 自 图 书 资 讯 学 、 资 讯 管理 学 及 资讯 工程 学 等 
系 所 219 位 大 学 生 及 硕士 生 所 鳄 知 的 资讯 概念 。 透 过 内 容 分 析 法 
检视 其 图 像 元 素 与 意 涵 ， 研 究 发 现 来 自 不 同系 所 学 生 所 绘 稻 之 资 
讯 方块 类 型 分 布 情形 有 些 相 似 ， 然 其 用 以 表述 资讯 之 元 素 繁 简 程 
度 不 一 ， 切 入 点 亦 有 所 不 同 。 图 书 资讯 领域 学 生 倾向 以 较 复 杂 的 
构图 ， 运 用 人 或 人 的 意象 、 纸 本 或 印刷 品 、 各 种 比喻 来 表述 资讯 
WA 程 与 资讯 阶 属 等 内 涵 。 相 
形 之 下 ， 资 讯 管理 领域 学 生 则 倾向 表达 资料 处 理 与 巨 量 资料 之 概 
念 ， 而 资讯 工程 领域 学 生 倾向 以 较 简 单 的 构图 或 工具 与 设备 来 呈 
现 资讯 之 概念 。 本 研究 所 此 提出 教学 相关 实务 建议 与 未 来 研究 建 
议 。 


关键 词 : 视觉 方法 ， 资讯 科学 ， 大 学 生 ， 资 讯 


国立 吉 淮 大 学 圆 书 资讯 学 系 助 理 教授 


E-mail: titsai@ntu.edu.tw 


研究 


http://joemls.tku.edu.tw 


Journal of Educational Media & Library Sciences 56 : 3 (2019) : 297-341 
DOI: 10.6120/JoEMLS .201911_56(3).0014.RS.BE 


A Comparative Analysis of 
English Abstracts and Summaries of 
Chinese Research Articles Indexed by 
the Taiwan Social Science Citation Index: 
Arts Education, Sports & Exercise, and 
Management Journals as Examples 


o 
ES 
J 
is 
+ 
m 
< 
= 
o 
a 
S 
D 
N 
o 
名 


Min-Chun Ku 


Abstract 


In addition to English abstracts, several journal publishers in Taiwan provide 
English summaries (or extended abstracts) along with Chinese research 
articles. English summary is a unique research genre emerged in response 
to foreign readers’ needs for Taiwanese scholarship. It resolves the problems 
caused by the inadequacy of English abstracts and the difficulties in translating 
full research articles into English. This study took the initiative to analyze and 
compare English abstracts and summaries to understand their structural and 
compositional differences. English abstracts and summaries provided by three 
of the six journals indexed by the Taiwan Social Science Citation Index (TSSCI) 
in 2016 and 2017 were content analyzed. These include: Research in Arts and 
Education (RAE), Sports & Exercise Research (SER), and NTU Management 
Review (NTU MR). Disciplinary differences were reflected in the structure and 
composition of abstracts and summaries. RAE authors wrote unstructured 
summaries unanimously. SER enforced the structured approach strictly. SER 
abstracts and summaries exhibited consistent IMRC structure. RAE and SER 
authors focused on reporting their studies and provided practical suggestions in 
summaries. NTU MR authors elaborated the contributions their studies made, 
limitations, and future research directions in summaries. The IMRAD/IMRD 
structure was decomposed and combined with the sections outlined in the NTU 
MR guideline. 


Keywords: Genre analysis, English abstracts, English summaries, Extended 
abstracts, Scholarly communication 


Introduction 
Some Chinese journals published in Taiwan provide both English abstracts 
and summaries along with Chinese articles. Different journals take different 
approaches to instruct authors to write quality summaries. Some take the 
structured approach, while some give authors freedom in determining what should 
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be included and how different components should be structured. Among all the 
journals indexed by the 2015 and 2017 TSSCI, only six provide both English 
abstracts and summaries. These include: Research in Arts Education (RAE), 
Sports and Exercise Research (SER), NTU Management Review (NTU MR), 
and three journals in the library and information science (LIS) discipline. One 
of the three LIS journals — Journal of Educational Media & Library Sciences 
(JoEMLS) — pioneered in providing English summaries. English summaries 
first appeared in JoEMLS in Volume 45, Issue 1 in October 2007. Subsequently, 
other two LIS journals — Journal of Library and Information Studies (JLIS) and 
Journal of Library and Information Science Research (JLISR) — started to provide 
English summaries. English summaries first appeared in NTU MR in Volume 23, 
Issue 2 in June, 2012. NTU MR published two issues every year at that time. It 
started to publish three issues annually since 2013. Seven or eight articles were 
published in each issue. Research articles, including tables, figures, and Chinese 
and English abstracts, should be written within 15,000 words. Authors can adjust 
the length of abstracts according to that of original articles. Authors are required 
to provide English summaries written within 1,200-1,500 words after receiving 
close-to-acceptance letters. They also have to translate Chinese citations into 
English. English summaries should faithfully present the information (data). 
Authors have to have their summaries edited by professionals to receive 
acceptance letters. NTU MR provides a guideline to instruct authors to write 
quality English summaries. It suggests that authors write informative summaries. 
Such summaries should contain the following sections: 1. Purpose/Objective: 
A concise introduction that states the main purpose of the study; 2. Design/ 
Methodology/Approach: Introduce the design or methods implemented to conduct 
the study; 3. Findings: Present test results or possible solutions conclusively; 4. 
Research Limitations/Implications: Identify the limitations that authors have faced 
and include important suggestions and relevant implications; and 5. Originality/ 
Contribution: State the contributions the study makes and provide insights for 
future research (NTU Management Review [NTU MR], 2019). 

English summaries started to appear in RAE in Volume 14, December 1, 
2014. RAE is a biannual journal that publishes two volumes every year. Four 
articles that fall into different areas of arts education, including visual arts 
education, music education, dance education, drama and design, are published 
in each volume. Chinese abstracts should be written within 350 words, while 
English abstracts should be written within 250 words. This indicates RAE has 
noticed translation results in the changes in word counts. Authors who submit 
in Chinese are required to provide English summaries written within 750-1,000 
words for the second round of review. Additionally, to) prepare for-the review 
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of being indexed by the Social Science Citation Index (SSCI), RAE requires 
authors to translate or transliterate Chinese citations into English (Research in 
Arts Education [RAE], n.d.). SER started to provide English summaries for 
foreign readers to browse and cite in Volume 18, Issue 1 on March 31, 2016. SER 
also wishes to be indexed by international citation indexes (Sports & Exercise 
Research [SER], n.d.). It is a quarterly journal that publishes four issues every 
year. In addition to editorials, it publishes eight articles in each issue. SER has 
relatively rigorous submission requirements. Authors should not cite anecdotic 
evidence or research output that has not been peer-reviewed, including theses, 
textbooks, and conference papers. The articles authors cite should be published 
within 5 years. Authors cannot cite more than 30 articles. Chinese and English 
abstracts should be written within 500 words. When Chinese submissions are 
accepted, authors are required to add English citations following the original 
Chinese citations. They have to submit English summaries written within 800- 
1,000 words. An example of English summary that contains a table is available 
on SER’s website. An English summary should have the introduction, method, 
results, and conclusions sections. Tables and/or figures should be concise and 
translated into English. Authors should only include the bibliographies cited in 
English summaries in their references. The editorial board invites domain experts 
to provide revision suggestions. Authors have to revise their summaries to have 
their articles published (SER, 2019). 

Journal publishers provide English summaries as part of the preparation 
for international citation index providers’ review. As a unique research genre, 
English summaries extend the functions of abstracts from guiding foreign readers 
to select studies of their interests to informing them of how specific studies were 
carried out and the results. They embody the efforts that journal publishers make 
to gain international recognition as well as the challenges they face to have their 
journals indexed by international citation indexes. English summaries facilitate 
scholarly communication between Taiwan and the rest of the world. However, our 
understanding of this genre is limited. To date there has no study that investigated 
the structure and composition of English summaries. It is important to bridge 
this gap. Thus, this study aimed at uncovering the structure and components of 
English summaries and comparing them with English abstracts; 

This study is part of a larger project that compared English abstracts and 
summaries provided by TSSCI-indexed journals. The author content analyzed 
abstracts and summaries of the six journals based on previous studies that 
analyzed abstracts and different sections of research articles across disciplines. 
This paper reports the results of analyzing RAE, SER, and NTU MR: The results 
of analyzing the three LIS journals have been reported in the other. article: partly 
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because they share identical disciplinary characteristics with minor differences.’ 
In addition to analyzing abstracts and summaries, the author also interviewed 
members of editorial boards and authors to understand how English abstracts 
and summaries have been edited and the writing difficulties authors have faced 
respectively. However, the response rate was extremely low when recruiting 
editors and authors of RAE, SER, and NTU MR. Only two NTU MR authors 
were interviewed. Members of NTU MR's editorial board did not participate 
partly because they did not involve in editing English abstracts and summaries. 
Authors were required to take full responsibilities. An important member of the 
SER editorial board and three professors who have served on the RAE editorial 
boards participated in interviews. The small number of interviewees and their 
under-representativeness made it difficult to uncover patterns within and across 
disciplines. Nevertheless, these interviewees provided insight into how English 
abstracts and summaries were written and processed. Thus, interview results will 
be used to help interpret the results of content analysis. 

What follows is the structure of this article: The author reviews previous 
studies on abstracts and different sections of research articles to form the 
analytical framework in the next section. Research on the composition of research 
articles is reviewed because there is a paucity of literature on English summaries. 
How English abstracts and summaries were collected and analyzed is then 
described in detail. The results of analyzing English abstracts in three journals 
are presented, followed by those of analyzing summaries. Fourth, comparisons 
between English abstracts and summaries are made. Limitations of this study and 
future research directions conclude this article. 


Literature Review 

Research articles are organized hierarchically. Each article is composed of 
distinct sections. Each section is composed of moves and each move is composed 
of steps. A move can be viewed as a communicative act (Lorés, 2004). It is a text 
segment that performs a specific communicative function. It is also a semantic 
unit relevant to authors’ purposes. It is composed of a bundle of linguistic 
features, which render a uniform orientation and signal the content of a discourse 
(Nwogu, 1997; Ruiying & Allison, 2003). A move may be realized by.a series 
of sentences, a sentence, a clause, a phrase, or a word (Pho, 2008). A step or 
multiple steps help realize the function of moves (Joseph, Lim, & Nor, 2014). 
Steps are organized in specific sequences. They represent the rhetorical choices 
that authors make (Ruiying & Allison, 2003). How often a move or step appears 
in a corpus determines whether it is obligatory, quasi-obligatory; or optional 


! Please see Ku (2019) for further reference. 
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(Joseph et al., 2014). Such frequency tends to be determined arbitrarily by genre 
researchers. Textual boundaries of moves can be distinguished based on content 
and linguistic criteria. For example, “play an important role” and “critical” are 
often used to “claim the centrality of the topic” (Kanoksilapatham, 2005). Some 
English summaries are composed of sections that are differentiated by headings, 
while some are not. Regardless of whether there are distinct sections, English 
abstracts and summaries of Chinese research articles are composed of moves and 
steps. 


Abstracts 
Definitions and types of abstracts 

The International Standard Organization (ISO, 1976) defined an abstract as 
“an abbreviated, accurate representation of the contents of a document, without 
added interpretation or criticism and without distinction as to who wrote the 
abstract.” The American National Standard Institute defined an abstract as “an 
abbreviated, accurate representation of a document which should be published 
with it and which is also useful in secondary publications and services” 
(American National Standard for writing abstracts, 1977, p. 252). National 
Information Standards Organization (NISO, 2015, p. 1) defined an abstract as “a 
brief, objective representation of the contents of a primary document or an oral 
presentation.” The above definitions emphasize that abstracts should reflect the 
original documents without distortion. The authorship should not be revealed and 
value judgements should not be included. ISO (1976) and NISO (2015) advised 
that abstracts should not be confused with summaries. NISO (2015, p. 2) defined 
a summary as “a brief restatement within a document (usually at the end) of its 
salient findings and conclusions intended to complete the orientation of a reader 
who has studied the preceding text.” This indicates a summary is part of the 
original document. Unlike an abstract, it cannot be separated from the original 
document. NISO’s definition deviates from the English summaries this study 
investigated. The ones this study investigated represent the whole documents 
and capture their essence. Because almost all the TSSCI-indexed journals that 
provide English abstracts and summaries use the term summary, including RAE, 
SER, NTU MR, JoEMLS, and JLISR, this study used it, despite the, definitional 
differences (Ku, 2019). Only JLIS uses the term extended abstract. 

Abstracts should provide essential information regarding the studies that 
have been carried out. They perform several functions. They allow readers to: 1. 
understand what a document is about quickly. Readers are informed of the topic 
or main arguments; 2. judge its relevance to their tasks at hand; and 3. decide 
whether it is necessary to read the entire document (ISO, 1976; NISO, 2015) or 
whether to pursue detailed information in original articles (Pho, 2008), which 
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may require translation. Abstracts are searchable in electronic environments. 
Authors should include terminology that aids in searching (NISO, 2015). Journal 
publishers tend to require authors to provide abstracts along with original research 
articles upon submission nowadays. Abstracts also allow readers to access 
documents written in another language. Many journal publishers in Taiwan 
require authors who submit in Chinese to provide both Chinese and English 
abstracts. The problem of abstracts written by non-English native speakers often 
lies in the lack of authorial voice (Pho, 2008). 
Types of abstracts 

Abstracts could also be classified based on functions. There are two types 
of abstracts, including: indicative abstracts and informative abstracts (ISO, 
1976; NISO, 2015). Some abstracts contain both informative and indicative 
elements. Indicative abstracts point out the nature and scope of the research 
article. Readers can understand the subject and findings, but they are not able to 
understand how the process was carried out (Lorés, 2004). Indicative abstracts 
are suited to less-structured or lengthy documents, such as editorials and books. 
They could also be used to indicate what are included in documents that do not 
contain methodology and results (ISO, 1976; NISO, 2015). Indicative abstracts 
should reveal the purpose and scope of the discussion, background information, 
the approaches that authors adopted, and major arguments. Informative abstracts 
are suited to documents that contain inquiries, surveys, or experimental studies. 
They condense original documents and reflect authors’ tone and contents (ISO, 
1976; NISO, 2015). It is expected that informative abstracts conform the rhetoric 
structure of research articles, that is, the IMRAD/IMRD (introduction, method, 
results, and discussion) structure (Lorés, 2004; NISO, 2015). Unfortunately, 
only 9.40% TSSCIL-indexed and 11.37% SSCI-indexed journal abstracts were 
informative (Chen, 2013). 
Structure and components of abstracts 

Abstracts could be divided into two types based on the degree of 
structuration, including unstructured, narrative abstracts and structured abstracts. 
First, narrative abstracts are written in one or more paragraphs. They are 
organized in logical sequence and can be read smoothly. However, they have been 
found to be deficient in that they did not report study design variables and data 
accurately (Zhang & Liu, 2011). Salager-Meyer (1990) found medical English 
abstracts suffered from several problems, including: the lack of fundamental 
moves (e.g., purpose or conclusions) or two or more necessary. moves, illogical 
sequence of move arrangement, and conceptual overlap in paragraph structure. 
Abstracts in SSCI-indexed journals did not provide sufficient information in one 
of the IMRD components, except for sociology journals htSome) TSSCI-indexed 
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journals in law and LIS did not contain informative results in their abstracts (Chen, 
2013). Second, structured abstracts, which have been introduced from science 
to social sciences and humanities disciplines, contain distinct headings that 
differentiate sections (Hartley, 2004; U.S. National Library of Medicine, 2018). 
The Ad Hoc Working Group for Critical Appraisal of the Medical Literature 
proposed structured abstracts, which should contain the following sections: 
objective, design, setting, patients or participants, interventions, measurements 
and main results, and conclusions. Hartley argued structured abstracts in journals 
should be written with the following headings: aims, methods, results, and 
conclusions (Zhang & Liu, 2011). It has been found the quality of structured 
abstracts was better than that of unstructured abstracts (Hartley, 2004; Taddio 
et al., 1994). The completeness and clarity of structured abstracts in software 
engineering were higher than conventional abstracts (Budgen et al., 2008). 
However, the IMRD structure are not always applicable to certain disciplines. For 
example, methods were not applicable to certain TSSCI-indexed journals in law 
and economics and SSCI-indexed journals in law, psychology, economics, and 
management (Chen, 2013). While structured abstracts are able to provide writing 
instructions, it is important to develop a cross-disciplinary framework that allows 
authors to decide which components to include and how they are presented and 
combined (Lin, Lin, Shaw, Chang, & Chen, 2016). 

Both top-down and bottom-up approaches have been taken to unfold the 
move structure of abstracts. The former refers to distinguishing moves based on 
content or function. The latter is based on linguistic cues, such as verb tense (Pho, 
2008). Pho (2008) took the top-down approach to identify the rhetorical moves of 
abstracts of empirical research in applied linguistics and educational technology. 
The framework he used contained the following five moves: situating the research, 
presenting the research, describing the methodology, summarizing the findings, 
and discussing the research. The three moves in the middle were obligatory. 
Pho (2008) also found disciplinary differences in generic structure. The move 
"discussing the research" was more common in applied linguistics. Liddy (1991) 
proposed a typical structure of empirical abstracts based on a three-phase study 
of psychology abstracts. Three types of components comprised the structure, 
including: prototypical, typical, and elaborated components... Prototypical and 
typical components include: Relation to other research, purpose: hypothesis, 
methodology: subjects: sample selection, methodology: procedures: conditions, 
methodology: data collection, results: discussion, conclusions: implications 
and references. Cross and Oppenheim (2006) analyzed the move structure of 
12 protozoological abstracts. They identified five moves, including: relation to 
other research, purpose, methodology, summarizing, the results, and discussing 
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the research. Move 5 contained two sub-moves, including conclusions and 
recommendation. Kelly and Yin (2007) suggested researchers provide informative 
abstracts. The moves they suggested include: Background and context, purpose/ 
objective/research questions/focus of study, setting, population/participants/ 
subjects, intervention/program/practice, research design, data collection and 
analysis, findings/results, and conclusions/recommendations. Lorés (2004) 
found most linguistics abstracts were informative. They contained the following 
sections and moves: 1. Introduction: Outline the author's purpose, study goals or 
problems; 2. Methods: Indicate the ways the problems were studied, including the 
data collected and the methodology; 3. Results: Summarize general findings; and 
4. Discussion: Interpret the results, and indicate implications and how findings 
can be applied. Lin et al. (2016) identified the information elements that should 
be included in monograph abstracts from humanities scholars’ perspectives, 
including: 1. Problem statement; 2. Target or materials being analyzed (e.g., 
works, creators, or historical materials); 3. Research methods or theoretical 
perspectives (e.g., theories drawn on, authors’ ways of thinking, or interpretation 
of texts or materials); 4. Relations with existing research; and 5. New insight, 
outcomes, or conclusions. 


Moves and Steps that Comprise Different Sections of 
Research Articles 


Previous studies have analyzed the composition of research articles in 
different disciplines and areas of studies. While some analyzed the whole 
research articles, some focused on specific sections. Nwogu (1997) investigated 
the structure of prestigious medical research papers. The moves and steps he 
identified are presented in Table 1 (Nwogu, 1997). To uncover the complete 
rhetoric structure, Kanoksilapatham (2005) analyzed the IMRD sections of 
biochemistry research articles published in top five journals in 2000. Table 2 
presents the sections, moves, and steps he identified (Kanoksilapatham, 2005). 
This structure helped the present study develop the coding scheme, so it appears 
in this and the previous article. Kanoksilapatham (2005) found cyclic patterns in 
the introduction sections. Moves 1, 2, and 3 recurred as the complexity of a study 
increased. Both disciplinary and cultural variations affected the structure of the 
introduction sections. 

The introduction section 

Swales’ (1990, 2004) analyzed the introduction sections of research articles. 
The moves and steps he identified are presented in Table 3 (Swales, 1990, 2004). 

Swale’s results have been adopted and extended. Drawing on Swales’ 
Create-A-Research-Space (CARS) model, Posteguillo (1999) analyzed the 
organization of research articles in computer science. The IMRD structure was not 
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Table 1 Rhetoric Structure of Medical Research Articles 


Introduction 


Methods 


Results 


Discussion 


305 


Move 1: Present 
background 
information 
Step 1: Reference 
to established 
knowledge in the 
field 
Step 2: Reference 
to main research 


Move 4: Describe 
data-collection 
procedure 
Step 1: Indicate 
source of data 
Step 2: Indicate 
data size 
Step 3: Indicate 
criteria for data 


Move 7: Indicate 
consistent 
observation 


Step 1: Highlight 


overall observation 


Step 2: Indicate 
specific 
observations 
Step 3: Account 


Move 9: Highlight 
overall research 
outcome 
Move 10: Explain 
specific research 
outcomes 
Step 1: State a 
specific outcome 
Step 2: Interpret 


problems collection for observations the outcome 
Move 2: Review Move 5: Describe made Step 3: Indicate 
related research experimental Move 8: Indicate significance of the 
Step 1: Reference procedures non-consistent outcome 


to previous Step 1: Identification Observations Step 4: Contrast 


research of main research present and 

Step 2: Reference apparatus previous outcomes 

to limitations of Step 2: Recount Step 5: Indicate 

previous research experimental limitations of 
Move 3: Present new process outcomes 


research 


Step 1: Reference 
to research purpose 


Move 11: State 
research conclusions 


Step 1: Indicate 


Step 3: Indicate 
criteria for success 


Move 6: Describe 


Step 2: Reference — data-analysis research 

to main research procedures implications 

procedure Step 1: Define Step 2: Promote 
terminologies further research 


Step 2: Indicate 
process of data 
classification 
Step 3: Identify 
analytical 
instrument/ 
procedure 


Step 4: Indicate 
modification 

to instrument/ 
procedure 


Source: Nwogu (1997, p. 133). 


applicable and no structural patterns were identified. Nevertheless, three sections, 
including introduction, results, and discussion/conclusions, appeared frequently. 
Step 1B of Move 3 and Step 3 of Move 1 appeared the most frequently in the 
introduction sections. Cyclical patterns were found in Move 2. Samraj (2002) 
analyzed the introduction sections in wildlife behavior and conservation biology. 
Wildlife behavior introductions were similar to CARS model, but background 
moves were included to describe the features of the species under investigation. 
Gaps in previous research justified the present studies. Conservation biology 
introductions contained more centrality claims and were strong in persuasion. 
The lack of biodiversity and species extirpation indicated the importance of the 
present studies. Such differences could be partly attributed to the applied versus 
theoretical orientation of the two disciplines and their length. Joseph et al. 
(2014) also adopted Swales’ CARS model to investigate the introduction sections 
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Table 2 Rhetoric Structure of Biochemistry Research Articles 

Introduction Methods Results Discussion 

Move 1: Announce the Move 4: Describe Move 8: State Move 12: Contextualize 

importance of the field ^ materials procedures the study 


Step 1: Claim the 
centrality of the topic 
Step 2: Make topic 
generalizations 
Step 3: Review 
previous research 
Move 2: Prepare for the 
present study 
Step 1: Indicate a gap 
Step 2: Raisea 
question 
Move 3: Introduce the 
present study 
Step 1: State 
purpose(s) 
Step 2: Describe 
procedures 
Step 3: Present 
findings 


Step 1: List materials 
Step 2: Detail 
the source of the 
materials 
Step 3: Provide the 
background of the 
materials 
Move 5: Describe 
experimental 
procedures 
Step 1: Document 
established 
procedures 
Step 2: Detail 
procedures 
Step 3: Provide the 
background of the 
procedures 
Move 6: Detail 
equipment (optional) 
Move 7: Describe 
statistical procedures 
(optional) 


Step 1: Describe aims 
and purposes 
Step 2: State research 
questions 
Step 3: Make 
hypotheses 
Step 4: List 
procedures or 
methodological 
techniques 
Move 9: Justify 
procedures or 
methodology 
Step 1: Cite 
established 
knowledge of the 
procedure 
Step 2: Refer to 
previous research 
Move 10: State results 
Step 1: Substantiate 
results 
Step 2: Invalidate 
results 
Move 11: State 
comments on the results 
Step 1: Explain the 
results 
Step 2: Make 
generalizations or 
interpretations of the 
results 
Step 3: Evaluate the 
current findings 
Step 4: State 
limitations 
Step 5: Summarize 


Step 1: Describe 
established 
knowledge 
Step 2: Present 
generalizations, 
claims, deductions, 
or research gaps 
Move 13: Consolidate 
results 
Step 1: Restate 
methodology 
(purposes, research 
questions, hypotheses 
restated, and 
procedures) 
Step 2: State selected 
findings 
Step 3: Refer to 
previous literature 
Step 4: Explain 
differences in 
findings 
Step 5: Make 
overt claims or 
generalizations 
Step 6: Exemplify 
Move 14: State 
limitations of the study 
Step 1: Limitations 
about the findings 
Step 2: Limitations 
about the 
methodology 
Step 3: Limitations 
about the claims 
made 
Move 15: Suggest 
further research 
(optional) 


Source: Kanoksilapatham (2005, pp. 290-291) & Ku (2019, p. 47). 


of forestry research articles. Forestry introductions were similar to the CARS 


model. Cyclic patterns of moves occurred, which contributed to the differences in 


the number of moves. The appearance of Move 1 and Move 3 in all the forestry 


introductions they investigated made them resemble wildlife behavior and civil 


engineering introductions. All the moves were obligatory. Two steps were 


obligatory; two were quasi-obligatory; and five were optional. 


Ozturk (2007) explored whether there were sub-disciplinary variations in the 


introduction sections in second language acquisition and second language writing 


based on Swales' CARS model. These are subdisciplines of applied linguistics. 


The length of the introduction sections and whether an area of study was 


established affected cyclic patterns and the appearance of moves. For example, 
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Table 3 Moves and Steps of the Introduction Sections 


Introduction 
Move 1: Establish Step 1: Claim centrality 
a territory Step 2: Make topic generalizations 


Step 3: Review items of pervious research 
Move 2: Establish Step 1A: Counter-claim 
a niche Step 1B: Indicate a gap 

Step 1C: Raise questions 

Step 1D: Continue a tradition 


Step 2: Present positive justification 


Move 3: Present Step 1: Announce the research purposively or descriptively 
the present work/ A : 
Occupy the niche Step 1A: Outline purposes 

Step 1B: Announce the present research 


Step 2: Present hypotheses, questions and assumptions (optional) 


Step 3: Definitional clarifications (optional) 


Step 4: Summarize methods (optional) 


Step 5: Announce principal findings/outcomes 


Step 6: State the value of the present research 


Step 7: Outline the structure of the paper 
Source: Swales (1990, pp. 141-142, 2004, p. 230). 

as an established field, second language acquisition introductions followed the 
M1-M2-M3 structure. In contrast, as an emerging field, second language writing 
introductions contained more “topic generalization” and “literature review”. Two 
types of structure were found, including M1-M2-M1-M3 and M1-M3. 
The methods section 

Lim (2006) investigated the communicative functions of the methods 
sections of management research articles. The rhetorical moves and constituent 
steps he identified are presented in Table 4 (Lim, 2006). 
The results and discussion sections 

Holmes (1997) compared the moves that comprised the discussion sections 
in three disciplines, including: history, political science, and sociology. The 
structure he adopted contains the following moves: 1. Background information; 2. 
Statement of results; 3. (Un)expected outcome; 4. Reference to previous research; 
5. Explanation of unsatisfactory result; 6. Generalization; 7. Recommendation; 
and 8. Outline parallel or subsequent developments. There were no obligatory 
moves. The discussion sections started with either move | or 2. All the moves 
have closed the sections except for move 1. The most frequently appeared moves 
were moves 6 and 2. Disciplinary variations were found in the move structure. 
For example, while sociologists preferred move 2, political scientists preferred 
move 6. Move 8 only appeared in history. Cyclic patterns were found in 
political science, but not in history. The results sections of the research articles in 
computer science that Posteguillo (1999) analyzed include the following moves: 
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Table 4 Moves and Steps of the Methods Sections 


Methods 
Move 1: Describe data Step 1: Describe the sample 
collection procedure/s Step 1A: Describe the location of the sample 
Step 1B: Describe the size of the sample/population 
Step 1C: Describe the characteristics of the sample 
Step 1D: Describe the sampling technique or criterion 
Step 2: Recount steps in data collection 
Step 3: Justify the data collection procedure/s 
Step 3A: Highlight advantages of using the sample 
Step 3B: Show representativity of the sample 
Move 2: Delineate Step 1: Present an overview of the design 
dure/s f 
Mensa: vorisBles Step 2: Explain method/s of measuring variables 


Step 2A: Specify items in questionnaires/databases 
Step 2B: Define variables 
Step 2C: Describe methods of measuring variables 


Step 3: Justify the method/s of measuring variables 
Step 3A: Cite previous research method/s 
Step 3B: Highlight acceptability of the method/s 


Move 3: Elucidate data Step 1: Relate (or “recount”) data analysis procedure/s 
analysis procedure/s 


Step 2: Justify the data analysis procedure/s 


Step 3: Preview results 
Source: Lim (2006, p. 287). 

1. Metatextual categories: Pointer and structure of sections; 2. Presentational 
categories: Procedural, hypothesis restated, and statement of data; 3. Comment 
categories: Comparison of findings with literature, evaluation, further research 
suggested, implications, and summarizing. Williams (1999) analyzed the results 
sections of eight research reports in medicine. The communicative categories 
comprising his model were similar to Posteguillo's (1999). Only the steps 
comprising moves 2 and 3 slightly varied. These include: 2. Presentational 
categories: Procedural, statement of findings/result, substantiation of finding, and non- 
validation of finding; and 3. Comment categories: Explanation of findings, comparison 
of findings with literature, evaluation of findings re hypothesis, and implications of 
findings. Williams’ (1999) model is adequate for interdisciplinary analysis. 

Peacock (2002) compared the discussion sections across seven disciplines, 
including: physics and material science, biology, environmental science, 
business (marketing and management), language and linguistics, public and 
social administration, and law. The structure he adopted contains the following 
moves: information move (background about theory/research aims/methodology), 
statement of result (in numerical values or with references to graphs or tables), 
finding (without references to graphs or tables), (un)expected outcome, reference 
to previous research, explanation (reasons for unexpected results), claim. (a 
generalization derived from the results), limitation, and recommendation 
(suggestions for future research). Cyclic patterns include: 1. Introduction: 
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Moves 1, or 1 + 5, or 2/3; 2. Evaluation: Moves 2/3 and 5, 7 and 5, or 5 and 
7; and 3. Conclusion: Moves 3 and 7, or 9. No moves were obligatory. The 
most frequently appeared moves include: claim, finding, reference to previous 
research, and recommendation. Information move appeared more frequently in 
physics and biology. Reference to previous research and cyclic patterns appeared 
more frequently in language and linguistics. Cyclic patterns also appeared more 
frequently in law, but less frequently in physics and environmental science. 
Ruiying and Allison (2003) studied how research articles in applied 
linguistics presented their results and drew conclusions. They examined the 
results, discussion and subsequent sections of 20 research articles. The moves and 
steps they identified are presented in Table 5 (Ruiying & Allison, 2003). The above 
sections were inter-related. Cyclic patterns were also identified in these sections. 
Authors reported their results and commented on their results. Their primary 
communicative purposes determined the sections and corresponding headings. 


Table 5 Moves and Steps of the Results and Discussion Sections 


Results/Discussion 


Move 1: Preparatory information 


Move 2: Reporting results 


Move 3: Commenting on results Step 1: Interpreting results 


Step 2: Comparing results with literature 


Step 3: Evaluating results 


Step 4: Accounting for results 


Move 4: Summarizing results 


Move 5: Evaluating the study Step 1: Indicating limitations 


Step 2: Indicating significance/advantage 


Step 3: Evaluating methodology 


Move 6: Deductions from the research Step 1: Making suggestions 


Step 2: Recommending further research 


Step 3: Drawing pedagogic implication 


Conclusion 


Move 1: Summarizing the study 


Move 2: Evaluating the study Step 1: Indicating significance/advantage 


Step 2: Indicating limitations 


Step 3: Evaluating methodology 


Move 3: Deductions from the research Step 1: Recommending further research 


Step 2: Drawing pedagogic implication 


Pedagogic implications 


Move 1: Summarizing the study 


Move 2: Dealing with pedagogic issues Step 1: Indicating necessity for pedagogic change 


Step 2: Drawing pedagogic implications 


Move 3: Evaluating the study Step 1: Indicating limitation 


Step 2: Indicating significance/advantage 


Move 4: Deductions from the research Step 1: Recommending further research 


Source: Ruiying and. Allison-(2003; pp. 374,376). 


310 Journal of Educational Media & Library Sciences 56 : 3 (2019) 


Research Methods 


Data Collection 

To ensure the recency and topic diversity of the corpus, Chinese research 
articles published in RAE, SER, and NTU MR published in 2016 and 2017 were 
selected for analysis. Regardless of the types of research, authors are required 
to provide English summaries for their Chinese articles. Thus, different types 
of research articles were included. English research articles and editorials were 
excluded. To facilitate comparisons across disciplines, full texts of Chinese 
research articles were downloaded from the Airiti Library database. English 
abstracts and summaries were copied from full texts and pasted on Word files. 
Dedoose, a cross-platform application for analyzing qualitative data, was adopted 
to facilitate data analysis. Two separate projects were created— one for analyzing 
abstracts and the other for summaries. Table 6 illustrates the number of research 
articles analyzed (Ku, 2019). The number of articles varied in three journals 
because the number of issues they published each year and the number of articles 
published in each issue were different. This partly reveals the size of the three 
disciplines they represent respectively. 


Table 6 Journals and Number of Articles Included 


Journal titles Nin 2016 Nin 2017 Total 
RAE 8 8 16 
SER 23 25 48 
NTU MR 21 23 44 
Total 52 56 108 


Source: Ku (2019, p. 49). 


Table 7 presents the number of abstracts that fall into different categories 
of word counts. The word counts of RAE abstracts range from 138 to 286. Two 
abstracts had more than 250 words. The average is 194 words. The word counts 
of SER abstracts range from 135 to 378. None exceeded the word limit. The 
average is 243 words. The word counts of NTU MR abstracts range from 70 to 
234. NTU MR abstracts were shorter than SER and RAE abstracts. This probably 


Table 7 Number of Abstracts with Word Counts 


Word counts/Journals RAE SER NTU MR 
770-100 0 0 2 
101-150 3 2 14 
151-200 7 8 26 
201-250 4 19 2 
251-300 2 12 0 
301-350 0 5 0 
351-400 0 2 0 
Total 16 48 44 
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could partly be attributed to the former’s requirements. Authors adjusted the 
length of abstracts according to that of original articles. Short abstracts might 
have become the disciplinary norm. 

Table 8 presents the number of summaries that fall into different categories 
of word counts. Section headings, tables, and in-text citations were included in 
word counts. Bibliographical references were excluded. The word counts of RAE 
summaries range from 644 to 1,124. The average is 865 words. Six summaries 
did not meet the requirements. Three has less than 750 words and three has more 
than 1,000 words. The word counts of SER summaries range from 456 to 1,483. 
The average is 790 words. The word counts of NTU MR summaries range 
from 564 to 1,725. The average is 1,227 words. Overall, NTU MR summaries 
were longer than RAE and SER summaries. 


Table 8 Number of Summaries with Word Counts 
SER | NTU MR 


x 
By 


Word counts/Journals 
401-500 
501-600 
601-700 
701-800 
801-900 
901- 1,000 

1,001- 1,100 

1,101- 1,200 
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1,401- 1,500 

1,501- 1,600 

1,601- 1,700 

1,701- 1,800 
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Data Analysis 

Content analysis was implemented to analyze English abstracts and 
summaries (Neuendorf, 2002). Data analysis involved developing and revising 
the coding scheme, code, examine, and revise coding decisions iteratively. It was 
an evolving process in which the coder's understanding of the corpus increased. 
The coder must be able to read English without comprehension difficulties. 
The coder also had to understand previous genre research and the present 
study to develop the coding scheme. Thus, the author analyzed the corpus by 
herself. Abstracts were analyzed first, followed by summaries. Abstracts were 
read several times and compared. The sections, moves, and steps identified by 
previous studies, which were discussed in the literature review section, were 
applied and adapted according to the corpus. The internal reliability of the coding 
was ensured by developing the coding scheme based ona solid foundation of 
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previous research on abstracts and research articles (Miles, Huberman, & Saldaña, 
2014; Savolainen, 2011). Including diverse types of topics and research helped 
ensure the applicability of the findings (Miles et al., 2014). A coding scheme that 
detailed definitions of different coding categories with examples was developed 
based on all the abstracts analyzed. Check-coding refers to repeating the coding 
process with an independent coder and verifying the coding of selected cases 
(Regents of the University of Michigan, 2019). It was adopted because it suited 
lone researcher and this study served as the first attempt to unfold the structure and 
composition of English summaries (Savolainen, 2011). Additionally, it enhances 
definitional clarity and reliability (Miles & Huberman, 1994). Thus, after the 
coding scheme was fully developed, excerpts assigned to different codes were 
scrutinized. Confusing coding categories, such as "state purpose(s)" and "specify 
research themes", were differentiated and excerpts assigned to these codes were 
re-coded. Interviews also informed data analysis. An RAE author who has served 
on the editorial board contended English summaries should contain theoretical 
framework, not literature review. Thus, "theoretical framework" was added to 
the coding scheme. All abstracts were analyzed again to ensure the accuracy 
of coding decisions. The coding scheme was then used to analyze summaries. 
Additional coding categories, including: justify methods/participants, restate 
methodology, summarize the study, and the steps comprising significance, were 
developed. Definitions of several categories, including describe tasks/treatment/ 
procedures and state time frame, were expanded to encompass variations found 
in English summaries across disciplines. Original coding decisions made on 
abstracts were revised based on the changes of the coding scheme. Some excerpts 
were recoded. Appendix presents the coding scheme (Ku, 2019). There were 
minor differences in the structural position of the step “state hypotheses" and finer 
categorization of different types of "significance" in the coding schemes that this 
article and previous article present (Ku, 2019). The position of "state hypotheses" 
was relatively unstable. They appeared in different sections in different 
summaries. NTU MR authors tended to enumerate the contributions their studies 
made in a long paragraph. Thus, different types of contributions were compared 
to develop the codes. All abstracts and summaries were analyzed at least twice 
to ensure intra-coder consistency. Excerpts of different coding categories were 
scrutinized several times and corrected to ensure the accuracy of coding decisions. 

Abstracts and summaries were analyzed at corresponding levels of 
granularity. All the abstracts were coded at the move and step levels because they 
were unstructured. They did not have distinct sections differentiated by headings. 
Structured summaries were coded at the section, move, and step levels. because 
they contained all of these. Unstructured summaries were coded.at the move and 
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step levels. Because genre is dynamic, ever-evolving, this study did not aim to 
produce statistical results generalizable to English abstracts and summaries of the 
three journals. Descriptive statistics was used for subsequent analysis. 

Summaries were also analyzed along four dimensions, including: types of 
research they reported, whether they were structured, whether they contained 
tables and/or figures, and whether they contained citations. Table 9 presents the 
results of this analysis (Ku, 2019). Several dimensions emerged from interviews. 
Although most interviewees were LIS faculty, these dimensions were applicable 
across disciplinary boundaries. Additionally, several interviewees served on the 
editorial boards. They have handled English abstracts and summaries of different 
types of social science research. For example, when asking the differences 
between abstracts and summaries, an interviewee responded, “summaries have 
citations, tables and figures, while abstracts do not.” Thus, visual presentation 
and citations were applied for data analysis. Formula, especially unnumbered 
ones, were excluded. Only numbered tables and figures were included in visual 
presentation. 


Table 9 Number and Dimensions of English Summaries 
Dimensions/Journal titles RAE SER NTU MR 


Research types Empirical research 12 (75%) 48 (100%) 42 (95.5%) 
Conceptual discussion 4 (25%) 0 2 (4.5%) 
Structuration Structured 0 48 (100%) 34 (77.3%) 
Unstructured 16 (100%) 0 10 (22.7%) 
Visual presentation With tables and/or figures 1 (63%) 22 (45.8%) 3 (6.8%) 
Without tables and/or figures 15 (938%) 26 (54.2%) 41 (93.2%) 
Citations With citations 5 (313%) 48 (100%) 34 (77.3%) 
Without citations 11 (688%) 0 10 (22.7%) 


Source: Ku (2019, p. 63). 


All SER summaries reported empirical research. RAE had more summaries 
that reported conceptual discussion than NTU MR, although the number of RAE 
articles was lower than that of NTU MR articles. There were more qualitative 
studies and conceptual discussion in RAE. These probably demonstrate different 
journals’ research orientation. According to the three journals’ submission 
requirements, both SER and NTU MR take the structured approach, while RAE 
does not. However, SER enforced it strictly, while NTU MR did not. RAE authors 
wrote unstructured summaries unanimously, despite there was little instruction 
for authors. Only a RAE summary contained figures. RAE only sets up word 
limits for English summaries. No requirements with regard to the content were 
specified. Writing unstructured, narrative summaries without tables and figures 
might have become the norm among authors. The percentage of RAE summaries 
that did not contain citations was high, as opposed to NTU MR, All SER 
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summaries contained citations. This could be attributed to SER’s requirements 
for English summaries and the example it provides. The percentage of SER 
summaries that contained tables and/or figures was the highest among three 
journals. This probably could be attributed to the example it provides. 


Results and Discussion 


Structure and Components of English Abstracts 

Table 10 presents the frequency of sections, moves, and steps that comprised 
the English abstracts and summaries this study analyzed (Ku, 2019). The most 
frequently appeared moves and steps in abstracts across three journals include: 
state purpose(s), summarize individual results, describe subjects, describe the data 
being collected, practical applications, employ data collection methods, claim the 
centrality of the topic, and propose a new approach/draw on theories. Although 
frequencies are not equivalent to importance, they still demonstrate the most 
essential information to report in abstracts were purposes, study results, and target 
of the study. Most abstracts in three journals contained "state purpose(s)" and 
"summarize individual results". These two steps seem to be obligatory. 


Table 10 Frequency of Moves and Steps in 
English Abstracts (A) and Summaries (S) 


RAE SER NTU MR 


Sections Moves Steps 
A S A S A S 
Introduction Announce the Describe background 2 4 0 5 2 I 
importance of Claim the centrality of the topic s 10 5 22 8 18 
Make topic generalization 0 4 1 4 4 8 
Review previous research 2 7 853 0 28 
Prepare for the Indicate a gap(s) 3. 8 227 7 20 
present study Indicate the problem(s) 2 7 5 24 58 
Introduce the State purpose(s) 16 16 48 47 44 45 
present study Propose a new approach/Draw on theories 6 6 6 16 20 15 
Specify research themes 0 2 2 11 2 8 
List research questions 0 3 0 0 0 3 
State hypotheses 1 0 1 2 6 6 
Clarify definition/coverage/assumption 1 7 0 8 8 16 
Describe expected contributions 0 5 0 4 0 4 
Describe procedure 0- 17. 0.2 1 8 
Present findings 22 0 L,1 6 
Outline the structure of the article 0 3 4o'U 242 
Literature The main body 0 0450 1 O0 12 
Review Theoretical framework o 2 0 BAIT 
Methods Justify methods/participants o0 T @ E NJ 
Describe the overall data collection approach 4 ROf 5 12 
Describe pretest/pilot study 1 02,070 1 1 
Obtain IRB 0.0 0.8 0.0 
Select data collection site 0 1 0 4 1 4 
Describe sampling or exclusion criteria 1:,,/6:£:4 -10:..05 13 
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Describe subjects 6 18 41 51 17 33 

Collect data Employ data collection methods 6 12 18 26 5 19 

Describe the data being collected 5 12 21 39 14 41 

Describe data source 0 0 0 1 2 16 

Describe experiment design 1 1 611 0 0 

Assign subjects 0 3 17 21 1 1 

Describe tasks/treatment/procedures 2 4 2634 1 4 

State time frame 3 11 21 54 8 26 

Develop research instruments 1.11 3 19 40 5 

Employ specific measurement 2 3 4 11 4 5 

Employ data collection equipment 1 3 6 8 0 0 

Analyze data Employ data analysis methods/measurements 1 13 15 44 12 46 

Describe the data being analyzed 0 113 3 4 2 

State the purpose of data analysis 2 2 411 9 12 

Adopt data analysis software 0 1 2 10 0 5 

Verification 0 3 1 5 1 9 

Results Summarize individual results 15 13 49 22 41 22 

Evaluate system performance 0 0 0 0 1 1 

State comments Explain findings p. 24, 1 a 3 
on the results 

Discussion Consolidate Restate methodology 0 1 0 0 0 0 

results Summarize results 0 9 039 1 22 

State selected findings 0 0 0 0 0 3 

Refer to previous literature 0 9 O 11 0 20 

Compare results with literature 1 6 0 9 O 12 

Suggest further research 1 0 0 0 0 2 

Conclusions Make overt claims or generalizations 1 7 41 40 4 12 

Summarize the study 0 3 0 1 0 6 

Significance Be the first 0 0 1 2 1 7 

Study in a unique context 0.00 0 1 3 

Describe what has been accomplished 1 1 0 0 2 30 

Draw on specific perspectives 0 0 0 0 1 6 

Fill a gap(s) 0 0 0 1 0 15 

Relate to/extend previous studies 0 0 0 1 4 13 

Solve the problem 0 0 0 0 0 1 

Implications 4 6 3 7 4 30 

Limitations Limitations about the scope 1.0 0 1.0 17 

Limitations about the findings 0 1 0 0 0 19 

Limitations about the methodology 0 1 0 1 0 23 

Suggestions Practical applications 8 15 19 25 9 10 

Future research needs O 11 111 2 54 

Indicate content 3.2) 070544 3 

Other section headings 0 0 0 0 0.606 


Source: Ku (2019, pp. 64-66). 

The most frequently appeared moves and steps in RAE abstracts include: 
state purpose(s), summarize individual results, practical applications, claim the 
centrality of the topic, and employ data collection methods. The high frequency 
of "practical applications" indicates the results of RAE studies were exploited to 
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provide suggestions that help improve practices. RAE authors tended to announce 
the importance of their studies by “claiming the centrality of the topic". RAE 
abstracts started with “describe background”, “claim the centrality of the topic", 
or “state purpose(s)”. Most RAE abstracts ended with “practical applications". 
Three ended with “indicate content”. Almost all RAE abstracts contained “state 
purpose(s)" and “summarize individual results". They seem to be obligatory. 
“Claim the centrality of the topic” and “practical applications” seem to be quasi- 
obligatory because they appeared in some RAE abstracts. 

The most frequently appeared moves and steps in SER abstracts include: 
summarize individual results, state purpose(s), describe subjects, make overt 
claims or generalizations, describe tasks/treatment/procedures, state time frame, 
and describe the data being collected. These reflect SER’s strong focus on 
empirical research, especially experimental or quantitative studies that involved 
human or animal subjects. Authors tended to summarize different parts of results 
and then drew a generalized claim as conclusions. Several SER abstracts started 
with “claim the centrality of the topic", but most started with “state purpose(s)". 
Some ended with “practical applications”. Only one ended with “future 
research needs”. Some skipped “describe the overall data collection approach” 
and proceeded to “describe experimental design”. These authors reported the 
experimental design they implemented without pointing out they adopted the 
experiment methods first. “The purpose of this study was to determine the effects 
of Chlorella supplementation for four weeks on exercise-induced muscle damage 
and maximal muscle strength during recovery. In this randomized, double-blind, 
placebo-controlled study, 24 college badminton players were recruited” could 
serve as an example. This indicates experiment was a frequently implemented 
method. The number and types of participants and their demographic data were 
reported explicitly in consistent forms in SER abstracts. Parenthesis was used to 
report demographic data of participants. “Twenty-four university students, major 
in physical education (age: 22.0 + 1.7 yr, height: 172.7 + 4.9 cm, bodyweight: 
66.9 + 7.0 kg)” could serve as an example. This allows readers to extract and 
compare results across studies effectively, which could facilitate the development 
of systematic reviews. Most SER abstracts contained the following steps: state 
purpose(s), describe subjects, summarize individual results, and make overt 
claims or generalizations. These steps seem to be obligatory. “The number of 
these moves and steps was close to the number of SER abstracts analyzed. SER 
abstracts followed a clear IMRC structure. As revealed by an interviewee who has 
served on the editorial board for a long time, SER abstracts and summaries were 
edited by an Indian. He probably has been trained to identify and include these 
components in specific forms. Some also contained the following steps: employ 
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data collection methods, describe tasks/treatment/procedures, state time frame, 
assign subjects, and practical applications. These seem to be quasi-obligatory. 
Indicative components did not appear. All SER abstracts were informative. 

The most frequently appeared moves and steps in NTU MR abstracts 
include: state purpose(s), summarize individual results, propose a new approach/ 
draw on theories, describe subjects, describe the data being collected, and indicate 
content. The high frequency of “propose a new approach/draw on theories” 
indicates authors heavily drew on existing theories and models to achieve their 
purposes. The high frequency of “indicate content” reveals some abstracts were 
both indicative and informative. These abstracts ended with pointing out what 
was discussed and/or provided in the end of original research articles. Review 
articles that analyzed journal articles tended to contained this step. Several NTU 
MR abstracts started with either “claim the centrality of the topic” or “describe 
background”, but most started with “state purpose(s)". Some ended with “indicate 
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content”, “practical applications”, or “future research needs”. Most NTU MR 
abstracts contained "state purpose(s)" and “summarize individual results". They 
seem to be obligatory. “Propose a new approach/draw on theories", “describe 
subjects”, and “describe the data being collected” seem to be quasi-obligatory 
because they were included in some abstracts. 

Several moves and steps tended to co-occur. “State purpose(s)” and “propose 
a new approach/draw on theories” co-occurred 25 times. Most appeared in NTU 
MR. Several appeared in SER and RAE. These authors indicated the theories, 
models, perspectives, or concepts they adopted in their purpose statements. 
“Describe tasks/treatment/procedures” and “state time frame” co-occurred 17 
times. Almost all appeared in SER. Only one appeared in RAE. It did not appear 
in NTU MR. Temporal aspects of the treatments in experimental studies cannot be 
separated from the treatments. “Subsequent community-based health promotion 
program was performed (110 min per day, once per week, for 14 weeks) by 
exercise intervention group” could serve as an example. “Describe the data being 
collected” and “state time frame” co-occurred 14 times. These appeared mostly 
in NTU MR and SER abstracts. It only appeared in RAE abstracts once. NTU MR 
and RAE authors pointed out when the data were published or when they collected 
the data when reporting the data they collected. “The news related to competitive 
interactions among these companies in 2005 to 2012 are collected” could serve 
as an example. The above co-occurrences took place in the introduction and 
methods sections. Adjacent steps were inter-related and they tended to be realized 
together in a sentence or a series of sentences. 

Comparing the frequency of moves and steps comprising RAE, SER, and 
NTU MR abstracts reveals the following results: 1. *Announce-the, importance 
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of the field: Review previous research” appeared more frequently in SER than 
in RAE and NTU MR. The results of previous studies were described in SER to 
indicate the importance of the phenomena being investigated. 2. "Propose a new 
approach/Draw on theories” appeared more frequently in NTU MR than in RAE 
and SER. NTU MR studies tended to draw on one or more concepts, perspectives, 
frameworks, models, and theories. In-text citations appeared several times when 
this step appeared, although most abstracts did not contain citations” 3. “Clarify 
definition/coverage/assumption” appeared more frequently in NTU MR, while it 
rarely appeared in RAE and SER. These include the targeting market, industry, or 
area of study under investigation, such as the semiconductor industry in Taiwan, 
Asia markets, healthcare service design, and travel service. 4. “State hypotheses” 
appeared more frequently in NTU MR. These studies involved hypotheses testing. 
Terms including “hypothesize”, “argue”, “assume”, and “propose” signaled the 
rhetorical functions of this step. 

5. “Describe subjects” appeared more frequently in SER. Most SER studies 
reported empirical, quantitative studies that involved human or animal subjects. 
Subjects in other two journals were embedded in other steps. Readers have to find 
who the subjects were. “Informal interviews were conducted with the mother” 
could serve as an example. 6. “Employ data collection methods" appeared more 
frequently in SER, while it rarely appeared in NTU MR. The former primarily 
reported the number of valid questionnaires SER authors obtained. This step also 
includes other methods, such as semi-structured interviews and documentary 
analysis. An NTU MR author stated in the interview that regression analysis 
was the most common method in the management discipline. Authors only 
have to report the methods they adopted or the data they used when these were 
unique. This probably explains why this step rarely appeared in NTU MR 
abstracts. 7. "Describe the data being collected" appeared more frequently in 
SER and NTU MR. The former includes: blood samples, muscle biopsy samples, 
and data collected by specific measurements (e.g., "stature, wright and a battery 
of fitness"). The latter primarily includes the journals authors collected and 
analyzed to write their review articles. 8. “Describe experiment design" appeared 
more frequently in SER. These include: cross-over design, counterbalanced and 
measures design and within-subject design. 9. “Assign subjects", "describe tasks/ 
treatment/procedures"', and “state time frame" appeared rather frequently in SER: 
Many SER abstracts reported experimental studies. 10. “Employ data collection 


? The abstract text from the article “Behavioral Intention of Earnings Management: The Explanation 
of Agency Problem, Moral Development and Theory of Planned Behavior" could serve as an 
example: Based on Ajzen (1985) Theory of Planned Behavior (TPB) and the concept of agency 
Theory as well as moral development. 
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equipment” appeared more frequently in SER. These include: a mega high-speed 
camera, the dual energy X-ray absorptiometry, a motion capture system and two 
force plates, portable heart rate monitor (Polar RS800CX), and so on. These 
were used to measure and collect data. 11. “Employ data analysis methods/ 
measurements” appeared frequently in SER and NTU MR, while it rarely appeared 
in RAE. These include: content analysis, discourse analysis, structural equation 
modeling, and so on. 12. “Describe the data being analyzed” appeared more 
frequently in SER. These include: “the joint moment, joint work and joint power 
of lower limb” and the elements found in blood samples. 13. “State the purpose 
of data analysis” appeared more frequently in NTU MR. 

14. “Summarize individual results” appeared more frequently in SER and 
NTU MR than in RAE. This roughly reflects the number of abstracts analyzed. 
15. “Make overt claims or generalizations” appeared more frequently in SER. 
Most SER abstracts contained concluding claims that addressed the purpose(s) 
of the study. “This study concluded that Tai Chi exercise could improve stability 
and walking speed of the elderly due to superior energy generation in the hip 
and knee” could serve as an example. 16. Overall, “significance” appeared more 
frequently in NTU MR. The guideline it provides probably contributed to it. 
This might also be a disciplinary norm. 17. “Practical applications” appeared 
more frequently in SER. It also appeared frequently in RAE given the number of 
abstracts included in RAE was lower. Practical advices were provided based on 
either the results or concluding claims. “We recommend that aquatic resistance 
plyometric training could be applied with tapering, which may be beneficial to 
maintain the specific physical fitness in the longer season” could serve as an 
example. 18. “Indicate content" appeared more frequently in NTU MR, but it did 
not appear in SER abstracts. These tended to point out the concluding contents 
of the original articles, including theoretical and practical implications and 
suggestions for future research. SER abstracts were informative, while some NTU 
MR and RAE abstracts were both informative and indicative. 


Structure and Components of English Summaries 
Sections of English summaries 

Structured summaries were composed of sections, moves, and steps, while 
unstructured ones were composed of moves and steps. Table 11 presents the 
frequency of sections that appeared in summaries (Ku, 2019). The number of 
sections reflects the degree of structuration of the three journals. They exhibited 
contrasting features. All RAE summaries were unstructured, so there were no 
section headings. Almost all SER summaries conformed the IMRC structure, 
except for one summary. Only one summary did not have the conclusion 
section. All of the section headings in SER summaries-were the same~ Authors 
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used conventional IMRC section headings consistently. This indicates that SER 
enforced the structured approach strictly. 


Table 11 Frequency of Section Headings 
in English Summaries 


Journals/Sections RAE SER NTU MR 


Introduction 0 48 34 
Literature review 0 0 3 
Methods 0 48 21 
Results 0 48 26 
Discussion 0 0 2 
Conclusions 0 47 9 
Other section headings 0 0 66 


Source: Ku (2019, p. 68). 


Although NTU MR takes the structured approach, it was not enforced 
strictly. Some authors have consulted the guideline that NTU MR provides, 
some did not. Those who have consulted it interpreted it differently. Most 
authors directly used the section headings outlined in the guideline (e.g., Design/ 
Methodology/Approach). Only a few authors selected one or two terms from 
the suggested headings to create their own headings. Some authors combined 
conventional IMRD headings with the headings outlined in the guideline. 
“Purpose/objective” was frequently used to denote the “introduction” section. 
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"Purpose", “objective”, “introduction and study purpose”, “introduction and 
literature review", “introduction and contribution" were also used. These indicate 
the main purpose of this section was to describe the study purpose. These also 
reflect the literature review sections have been incorporated in the introduction 
sections. “Design/Methodology/Approach” was frequently used to denote the 
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methods sections. Other headings, including “data and methodology", “research 
model”, “samples and study procedure", “data and findings", “methodology” and 
"research methods" were also used. These indicate the importance of describing 
the data/sample used in these studies. “Findings” was frequently used as a section 
heading. The term "results" only appeared several times. The discussion section 
almost disappeared in NTU MR summaries. It only stood out as a section by 
itself once. It was combined with the conclusion section once. Some NTU MR 
summaries ended with the conclusion sections. Many ended with the “research 
limitations/implications" and “originality/contributions” sections. Limitations, 
implications, originality, and contributions were decomposed and combined to 
form sections. One of these stood out as separate sections in some cases, such 
as "implications" and "research limitations". Finally, two NTU MR authors 
did not follow the structural sequence outlined in the NTU MR guideline. .The 
contribution sections followed the introduction sections. They probably used 
these to replace the step “describe expected contributions". 
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Moves and steps comprising different sections of English summaries 

The most frequently appeared moves and steps in summaries across three 
journals include: state purpose(s), describe subjects, employ data analysis 
methods/measurements, describe the data being collected, state time frame, 
summarize results or summarize individual results, employ data collection 
methods, and practical applications. These slightly differ from the most 
frequently appeared moves and steps in abstracts. Sometimes “employ data 
analysis methods/measurements” were omitted in abstracts, but they were 
included in summaries. Thus, its frequency increased. Additionally, authors 
took different approaches to write summaries. Some described individual results 
in detail, while some just presented the final, overall results. Thus, “summarize 
results” frequently appeared. The frequency of “propose a new approach/draw on 
theories” reduced in summaries probably because the theories or models authors 
adopted were realized in “review previous research" and “theoretical framework". 
Most summaries contained the following steps: state purpose(s), describe subjects, 
data analysis methods, and summarize results. They seem to be obligatory. 

The most frequently appeared moves and steps in RAE summaries include: 
describe subjects, state purpose(s), practical applications, summarize individual 
results, employ data analysis methods/measurements, employ data collection 
methods, and describe the data being collected. These reflect the importance of 
human subjects and RAE results yielded practical advice. Most RAE summaries 
started with “claim the centrality of the topic”. A few started with “describe 
background”. Most ended with “future research needs”. Two ended with “indicate 
content”. Most RAE summaries contained the following steps: state purpose(s), 
describe subjects, summarize individual results or summarize results. These seem 
to be obligatory. Some contained more moves and steps in the methods sections. 

The most frequently appeared moves and steps in SER summaries 
include: state time frame, review previous research, describe subjects, state 
purpose(s), employ data analysis methods/measurements, make overt claims 
or generalizations, and describe the data being collected. When the treatments 
were given and how often the treatments were reported in detail in experimental 
studies. Citations appeared when authors reviewed previous research. The length 
of the SER introduction sections varied. Some were long, while some were 
short. Literature review was incorporated in the introduction sections in a few 
summaries. "Review previous research" was used to point out the importance 
of the issue, indicate the gaps in previous literature, and serve as the literature 
review sections. Just like abstracts, SER summaries tended to describe subjects in 
similar forms. Terms including “this study concluded" and “our findings indicate” 
frequently appeared to signal the step “make overt. claims. or generalizations”. 
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Most SER summaries started with “claim the centrality of the topic”. Only a few 
started with “describe background”. Most ended with “practical applications”. 
Some ended with “future research needs”. Most SER summaries contained the 
following moves: review previous research, state purpose(s), describe subjects, 
summarize results, and make overt claims or generalizations. These seem to be 
obligatory. The consistent appearance of these steps probably resulted from the 
well-trained editor, SER’s rigorous requirements, and the example it provides. 
Many SER summaries contained moves and steps in the method and introduction 
sections, including: employ data analysis methods/measurements, state time 
frame, employ data collection methods, and describe tasks/treatment/procedures. 
These seem to be quasi-obligatory. Just like SER abstracts, SER summaries did 
not contain indicative components. All were informative. 

The most frequently appeared moves and steps in NTU MR summaries 
include: significance, suggestions, limitations, state purpose(s), employ data 
analysis methods/measurements, describe the data being collected, describe 
subjects, summarize individual results or summarize results, indicate the 
problem(s), and review previous research. The frequency of significance, 
limitations, and suggestions were much higher than those in RAE and SER 
summaries. This probably could be attributed to the guideline it provides. NTU 
MR authors wrote long paragraphs to report research limitations/implications 
and originality/contribution. However, some wrote very short paragraphs for the 
findings sections. Limitations and future research needs tended to be written in 
sequence. The former suggested the latter. “First of all, this study focused on 
manufacturing firms and did not investigate the cognition and relative responses 
of distributors. Future studies can expand our research by providing two-side 
view of manufacturer-distributer relationship” could serve as an example. A 
paragraph tended to contain multiple “limitations and future research needs” 
cyclical patterns. Most NTU MR summaries started with “claim the centrality of 
the topic”. Some started with “describe background”. Most ended with “future 
research needs”. Most NTU MR summaries contained the following steps: state 
purpose(s), data analysis methods, summarize results or summarize individual 
results, and implications. These seem to be obligatory. 

Adjacent steps in the methods sections frequently co-occurred. Several 
adjacent steps in the introduction and results sections also co-occurred. “Describe 
the data being collected” and "state time frame” co-occurred 42 times in three 
journals. “Describe tasks/treatment/procedures” and “state time frame” co- 
occurred 32 times. Most appeared in SER. Only a few appeared in RAE and NTU 
MR. "Review previous research" and “indicate the problem(s)” co-occurred 29 
times. Most appeared in SER and NTU MR with citations.; Only.two appeared in 
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RAE without citations. “Refer to previous literature” and “compare results with 
literature” co-occurred 24 times in three journals. Citations appeared when these 
co-occurrences took place. “State purpose(s)” and “propose a new approach/draw 
on theories” co-occurred 20 times in three journals. Most appeared in NTU MR. 
“Describe subjects" and "state time frame" co-occurred 20 times in three journals. 
“Employ data collection methods" and "describe the data being collected" co- 
occurred 19 times. These appeared more frequently in RAE and SER. Only a few 
appeared in NTU MR. "Data analysis methods" and "state the purpose of data 
analysis" co-occurred 17 times. These only appeared in SER and NTU MR. "Data 
analysis methods" and "state the purpose of data analysis" co-occurred 17 times 
in SER and NTU MR. “Data analysis methods" and “data analysis software" 
co-occurred 17 times in SER and NTU MR. “Assign subjects" and “describe 
subjects" co-occurred 16 times. Most appeared in SER. Four appeared in RAE. 
None appeared in NTU MR. "Employ data collection methods" and "describe 
subjects" co-occurred 16 times in three journals. Most appeared in SER. "Review 
previous research" and "indicate a gap(s)" co-occurred 14 times. Most appeared 
in SER. Three appeared in NTU MR and one in RAE. “Employ data collection 
methods" and “describe subjects" co-occurred 14 times in three journals. The 
above co-occurrences reflect the inseparable relationships between co-occurring 
steps. Co-occurring steps were realized together in a sentence or a series of 
sentences. In some cases, co-occurring steps relied on each other to realize their 
rhetoric functions. For example, previous research was reviewed to indicate the 
problem(s) authors intended to address in their studies. Sometimes proposing a 
new approach was the study purposes. Sometimes drawing on specific theories 
helped achieve study purposes. 

Comparing the frequency of moves and steps appeared in summaries in 
RAE, SER, and NTU MR reveals the following results: 1. Authors of the three 
journals took two approaches to justify their studies, including "review previous 
research" and “claim the centrality of the topic". The former appeared more 
frequently in SER and NTU MR. In this way, the introduction sections of SER 
and NTU MR summaries were similar to wildlife behavior introductions (Samraj, 
2002). In contrasts, “claim the centrality of the topic" appeared more frequently 
in RAE summaries. The approach that RAE authors took to justify their studies 
was similar to conservation biology authors (Samraj, 2002). 2. "Review previous 
research" appeared the most frequently in SER. It also appeared frequently 
in NTU MR. Selected results of previous studies were stated to point out the 
importance of the present studies. 3. Authors of the three journals indicated the 
gaps that haven't been filled out and/or the problems they indented to address to 
justify their studies. "Indicate a gap(s)" appeared more frequently in SER; while 
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“indicate the problem(s)” appeared more frequently in NTU MR. 4. “Propose 
a new approach/Draw on theories” appeared more frequently in SER and NTU 
MR. It seems literature review was incorporated in this step. Citations appeared 
with the theories and models authors drew on. 5. “Specify research themes” 
appeared more frequently in SER and NTU MR. What was covered in the 
investigation was elaborated. 6. “List research questions” did not appear in SER. 
What was investigated probably was reported by either “stating purpose(s)” or 
“specifying research themes”. 7. “State hypotheses” appeared more frequently 
in NTU MR. Most appeared in the introduction sections. Only one appeared in 
the methods section. 8. “Clarify definition/coverage/assumption” appeared in 
three journals. Citations appeared when some SER and NTU MR authors defined 
key concepts or stated the assumptions of their studies. 9. “Describe expected 
contributions” appeared more frequently in RAE. “The results of this study are 
hoped to contribute to visual arts education in Taiwan and to shed the light on the 
development of this field as a whole” could serve as an example. 10. “Describe 
procedure” appeared more frequently in NTU MR. How the studies were carried 
out were briefly described in the introduction sections. “In this paper, a simulation 
and a survey data analysis are used to demonstrate the performances of these 
index statistics under multicollinearity” could serve as an example. 11. “Present 
findings” appeared more frequently in NTU MR. An overview of the final results 
was provided in the introduction sections. “This study suggests that a firm can 
establish or improve its customer relations management strategy effectively by 
examining of the determinants of customer profit contribution” could serve as an 
example. 12. “Outline the structure of the article" appeared more frequently in 
NTU MR, especially in review articles and conceptual discussion. 

13. “Literature review: The main body" and “theoretical framework” 
appeared more frequently in NTU MR. It rarely appeared in SER. Citations 
appeared in this move in some summaries. 14. "Justify methods/participants" 
appeared more frequently in NTU MR. These include data collection and analysis 
methods. 15. "Describe the overall data collection approach" appeared more 
frequently in RAE and NTU MR. These primarily include experimental studies 
and case studies that encompassed multiple data collection methods. 16. "Describe 
sampling or exclusion criteria" appeared in three journals. These include 
the sampling strategies that authors adopted (e.g., stratified sampling, cluster 
sampling, and purposive sampling) and the selection criteria. of subjects (e.g., 
“The exclusive criteria of the subject were including the neuromusculoskeletal 
injury or previous surgery in lower extremity or trunk"). 17. “Describe subjects” 
appeared rather frequently in three journals. These include: naturalistic inquiry, 
case studies, theory-driven and data-driven approaches, ethnographic work, 
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and so on. 18. “Employ data collection methods" appeared in three journals. It 
appeared the most frequently in SER. These primarily include survey research 
and other qualitative methods, such as observation and interview. 19. “Describe 
the data being collected” appeared more frequently in SER and NTU MR. These 
two journals accepted more empirical research. Authors spelled out what was 
collected, including the amount, types, and nature of data. 20. “Describe data 
source” appeared the most frequently in NTU MR. These include the databases 
where journal articles were obtained and websites and anonymous companies from 
which data were obtained. 21. “Describe experiment design", “assign subjects", 
and “describe tasks/treatment/procedures” appeared the most frequently in SER. 
These studies adopted experimental methods. These steps rarely appeared in NTU 
MR. 22. "State time frame” appeared the most frequently in SER because it was 
embedded in “describe tasks/treatment/procedures". It also appeared frequently 
in RAE and NTU MR, especially in review articles that reviewed journal articles 
published in a period of time. 23. "Develop research instruments" appeared more 
frequently in RAE and SER. The instruments include: questionnaires, parent- 
child music activities, movie clips, and art-education-therapy-oriented program. 
24. “Employ specific measurement" appeared the most frequently in SER. These 
measurements include different types of scales that participants filled out and 
indices. 25. “Employ data collection equipment" appeared the most frequently 
in SER. These equipment include: a diagnostic ultrasound system, ultimate frag 
suit, Polar Sport Tester, Vicon Motion System, and so on. Different types of 
equipment helped measure and collect data. NTU MR authors did not use any 
equipment, so this step did not appear. 26. *Employ data analysis methods/ 
measurements" appeared frequently in three journals. How data were analyzed 
were described step by step in some NTU MR summaries. 27. "State the purpose 
of data analysis" appeared more frequently in SER and NTU MR. What was 
estimated, calculated, tested, or determined was described. 28. *Adopt data 
analysis software" appeared the most frequently in SER. These include: different 
versions of SPSS, R software, Expert Choice 2000 software, and Kubios HRV 
analysis software (version 2.2). 29. “Verification” appeared the most frequently in 
NTU MR. These include: reliability, Delphi method, convergent and discriminant 
validity, and how bias was avoided. 

30. “Explain findings" appeared the most frequently in SER. The cause of 
what was found was explained. “Might be", “may”, "due to", and “was related 
to" were used to describe possible causes. 31. “Summarize results" appeared 
the most frequently in SER. Instead of spelling out findings in detail, some 
authors chose to present the final results. 32. “Refer to previous literature" 
and “compare results with literature" appeared in three journals,.but. the, most 
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frequently in NTU MR. Results were compared with what was found in previous 
studies. Similarities and differences were highlighted. Citations appeared when 
“referring to previous literature”. 33. “Make overt claims or generalizations” 
predominantly appeared in SER. Most SER summaries contained this step. “Our 
study concludes that aerobic performance of recreational cyclists enhanced by 30- 
min ischemia preconditioning, which is associated with increased peak oxygen 
consumption” could serve as an example. 34. Not many summaries contained 
“summarize the study". 35. "Significance" appeared predominantly in NTU MR, 
especially “implications”, “describe what has been accomplished”, and “fill a 
gap(s)”. This could be attributed to the guideline it provides. Different types 
of contributions that authors have made through their studies were enumerated. 
“Implications” was the most frequently mentioned significance in three journals. 
36. “Limitations” predominantly appeared in NTU MR, especially “limitations 
about the methodology”. This could also be attributed to the guideline it provides. 
37. “Practical applications” appeared more frequently in SER and RAE. Study 
results of these two journals were exploited to provide suggestions for improving 
practices. 38. “Future research needs” appeared the most frequently in NTU 
MR. This tended to co-occur with “limitations”. 39. “Indicate content” did not 
appear in SER summaries. “Outline the structure of the article” did not appear in SER 
summaries, neither. These indicate SER summaries were informative. In contrast, some 
RAE and NTU MR summaries contained both informative and indicative elements. 
Tables and/or figures in English summaries 

This study further analyzed the extent to which English summaries 
contained tables and/or figures. Table 12 illustrates the number of tables and 
figures that appeared in different sections (Ku, 2019). Tables and figures were 
predominantly used to present results. Only one RAE summary that reported 
empirical research contained figures. Figures were used to describe the test the 
author conducted on participants in the methods section and illustrate the results 
in the results section. The problem with this summary was that the numbering of 
figures began with “Figure 12” and ended with “Figure 16”. These figures should 
be renumbered when being extracted from the original article. SER contained the 


Table 12 Number of Tables and Figures 
in English Summaries 


Journals Sections Noftables Sections N of figures 


RAE Methods 1 
Results 4 

SER Methods 1 Methods 1 
Results 37 Results 8 

NTU MR Results 6 Results 3 


Source: Ku (2019, p. 71). 
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highest amount of tables and/or figures. This could be attributed to its explicit 
submission requirement and the example it provides. SER’s strong preference for 
experimental and quantitative studies probably also contributed to it. Statistical 
results might be better presented by tables and/or figures. The scarcity of tables 
and figures in NTU MR summaries probably could be attributed to the lack of 
tables and/or figures and instruction in its guideline and submission requirement. 

Comparisons between English Abstracts and Summaries 

The number of moves and steps appeared in summaries is higher than those 
appeared in abstracts. “State purpose(s)”, “describe subjects", and “summarize 
individual results” were the most frequently appeared steps in abstracts and 
summaries across three journals. “Describe the data being collected” and “practical 
applications” were also among the most frequently steps in abstracts and 
summaries, although their frequencies varied. Moves and steps that only appeared 
in summaries include: list research questions, describe expected contributions, 
literature review: the main body, justify methods/participants, obtain IRB, select 
data collection site, restate methodology, summarize results, state selected 
findings, refer to previous literature, and summarize the study. With higher word 
limits, authors were able to elaborate. Moves and steps comprising the discussion 
sections were included, although these tended to be written in the results sections. 
Previous literature was referred in different sections. 

Comparing the frequency of moves and steps that comprised abstracts and 
summaries reveals the following results: 1. “Propose a new approach/draw on 
theories” and “indicate content” appeared more frequently in NTU MR abstracts 
than in summaries. The use of specific theories or models highlighted the 
uniqueness of a study. Word limits affected the number of indicative elements 
in NTU MR abstracts and summaries. 2. Frequencies of “develop research 
instruments”, “employ data analysis methods/measurements", “verification”, 
and “future research needs” were much higher in summaries than in abstracts. 3. 
“Describe the data being analyzed” appeared more frequently in SER abstracts 
than in summaries. 


Conclusions 

The types of research that three journals accepted, the maturity of the three 
disciplines, frequently implemented data collection and analysis methods, are 
reflected in the structure and composition of English abstracts and summaries. 
With the involvement of the editorial board and strict enforcement of the 
structured approach, SER abstracts and summaries exhibited relative consistent 
structure and composition. In contrast, the editorial board’s focus on,Chinese 
research articles, authors’ responsibilities in proving their summaries have 
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been edited by native English speakers, the interpretations authors made to the 
guidelines, and disciplinary norms shaped the diverse configuration of RAE and 
NTU MR summaries. 

Journal publishers may consider whether to have editorial boards edited 
English abstracts and summaries to enhance the structural and compositional 
consistency. They will need to consider how authors wish to present their works 
as well as foreign readers’ needs for effective navigation of English abstracts 
and summaries. Providing a consolidated set of guidelines with a good example 
of English summary probably could achieve better instructional effectiveness. 
Editorial boards should provide clear guidance regarding whether and how 
authors could choose among different options. Authors could adapt to their 
unique studies. The use of tables and/or figures should be explicitly encouraged. 
Given that some journals accept studies that adopt relatively diverse research 
methods and those report conceptual discussion and system development, the 
types of studies, sections, and conditions that suite indicative components should 
be clearly specified. This study also suggests editorial boards explicitly state 
their purposes in providing English summaries, the efforts they have made to 
have their journals indexed by foreign databases and citation indexes, and what 
authors could do to contribute. The two NTU MR authors interviewed did not 
think foreign scholars would read NTU MR. One even stated it is a fantasy that 
providing English summaries would help enhance the international visibility 
of authors’ work. She described it as a “wonderful imagination”. Several LIS 
authors have received submission invitations from foreign journals and foreign 
readers’ questions regarding detailed findings of their studies. Testimonies 
regarding the effectiveness of English summaries in enhancing authors’ 
international visibility need to be discovered and publicized to encourage authors. 
Authors should also shoulder responsibilities in promoting their work. As 
suggested by a LIS interviewee, when presenting relevant works in conferences or 
uploading their works to personal websites, institutional or open repositories such 
as ResearchGate, authors may indicate “English summary attached". 

This study suffered from the following limitations: 1. It only analyzed 
English abstracts and summaries. Original research articles were not analyzed 
(Ku, 2019). Therefore, it is unclear how representative and informative English 
summaries were and the extent to which they differed from original articles. 
The example that SER provides and the guideline that NTU MR provides guided 
authors to write English summaries. Authors might have adapted to the guideline. 
However, the structure and composition of their research articles might be 
different. Comparing among abstracts, summaries, and original articles»would 
help develop a holistic understanding of their differences, although, there will, be 
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language issues because original articles were written in Chinese. 2. Sometimes 
a coding decision was made based on how an excerpt was related to other texts 
within a given summary. As a result, some excerpts were not as typical as 
others in a given coding category. 3. Different coding categories were treated as 
mutually exclusive. However, different sections, moves, and steps were inter- 
related, especially adjacent ones. For example, limitations were divided into 
three types, including: about the findings, about the methodology, and about the 
scope (Kanoksilapatham, 2005). As manifested in several NTU MR summaries, 
limitations about the methodology contributed to limitations about the findings. 
These inter-relationships have challenged data analysis because it was difficult to 
determine which code should be applied. Moreover, sometimes a move or a step 
could be viewed as equivalent to others. Authors expressed what was investigated 
in different ways. For example, “list research questions” and “specify research 
themes” are convertible. 

Future research could be undertaken in the following directions: 1. Compare 
the citations in English summaries and those in original research articles: This 
will allow us to understand the extent to which citations have been dropped. It is 
also crucial to unfold the characteristics of citations that were kept and dropped, 
and where citations appeared in summaries and their functions. How trustworthy 
a study is without citations in summaries should be explored from foreign 
readers’ perspectives (Ku, 2019); 2. Compare the tables and/or figures in English 
summaries and those in original articles: This will help understand the extent to 
which tables and/or figures were removed and characteristics of those that were 
kept; 3. Compare English abstracts and summaries between journals indexed and 
not indexed by TSSCI (Ku, 2019); 4. Longitudinal studies should be conducted to 
understand the evolution of English summaries since their commencement (Ku, 
2019); and 5. Foreign readers’ perspectives regarding what should be included in 
English summaries and how different components should be structured should be 
investigated to inform the development of writing guidelines. It is also important 
to understand how informative an English summary should be to grant use and 
citations (Ku, 2019). 
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体育 及 管理 期 刊 移 例 


古 敏 君 


除了 英文 摘要 ， 人 台湾 有 些 期 刊 出 版 商 亦 提供 英文 摘 销 (或 长 摘要 、 
延伸 摘要 )。 英 文摘 俏 为 独特 的 研究 文体 ， 因 应 外 国学 者 对 台湾 学 
和 术 之 需求 而 生 ， 玛 补 了 摘要 之 不 足 ， 也 解决 翻译 全 文 之 困难 。 本 
研究 比较 三 种 收录 於 党 湾 人 文 及 社会 科学 引文 索引 之 期 刊 之 中 文 
研究 文章 之 英文 摘要 与 摘 录 ， 分 析 其 结构 与 组 成 元 素 ， 包 含 :《 蔓 
术 教 育 研究 )、《 大 各 体育 学 刊 》 与 《台大 管理 论 莫 》。 结 果 颁 示 最 常 
出 现 於 摘要 与 摘录 之 元 素 相同 ， 艺 术 作 者 一 致 地 撰写 非 结 构 性 摘 
销 ， 大 专 体 育 学 刊 微 底 地 执行 结构 式 策 略 ， 其 结构 与 元 素 相 当 一 
致 。 艺术 和 与 体育 摘录 注重 报导 其 研究 ， 状 提 供 改进 实务 之 建议 ， 
管理 摘录 解构 了 IMRD 架构 ， 结合 期 刊 所 提供 指南 之 架构 且 重 新 
命名 ， 强 调 其 研究 页 献 、 限 制 与 未 来 研究 方向 。 


关键 词 : 文体 分 析 ， 美 文摘 要 ， 英 文摘 钞 ， 延 仲 摘要 ， 学 术 传 播 
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近年 来 ， 阅 读 理解 已 成 为 大 学 的 核心 通 识 课程 之 一 ， 而 翻转 式 学 
习 即 为 国内 教育 界 常 使 用 的 阅读 理解 相关 课程 教学 方法 。 本 文 探 
讨 如 何 应 用 深度 讨论 府 ePUB3 电子 书 翻 转 式 学 习 模 式 ， 状 针对 
运用 此 新 模式 的 阅读 理解 课程 进行 设计 ， 使 课程 能 运用 深度 讨论 
法 ， 增 加 学 生 分 析 与 综 整 的 能 力 ， 以 提升 学 生 的 阅读 理解 学 习 成 
效 。 本 文 运 用 此 课程 设计 讼 某 大 学 ! 阅读 教学 Re RAE 
读 单元 ， 芷 经 由 实务 教学 ` 淮 实验 研究 法 对 照 分 析 ， 以 及 学 生 
的 满意 度 调 查 ， 验 证 此 新 模式 的 学 生 学 习 成 效 及 满意 度 。 研 究 结 
果 显 示 ， 本 文 所 提出 的 阅读 理解 课程 设计 ， 透 过 应 用 深度 讨论 於 
ePUB3 电子 书 翻 转 式 学 习 模 式 ， 可 产 出 优 於 应 用 一 般 讨 论 的 学 生 
阅读 理解 学 习 成 效 ， 而 学 生 亦 相当 满意 此 种 模式 的 学 习 。 


关键 词 深度 讨论 ， 教 学 实务 ， 课 程 设 计 ， 阅 读 理解 ， 翻 转 式 
FH’ PUB ETE 


前 = 


根据 国际 天 证 素 着 研究 (progress in reading literacy study > fijf##PIRLS ) 的 
4ES& ' ARRA (reading literacy ) BREW FE PABEAS Sie Nee ' thee 
rp. pM . ERE SS CME RK > 2006) )。 而 阅读 素养 的 教学 ， 是 经 由 多 
元 而 仙 富 的 文本 阅读 ， 引 发 出 思考 提问 与 互动 讨论 的 教学 过 程 P 学 生 能 和 统 整 
知识 ， 店 将 知识 应 用 在 个 人 生活 以 及 工作 领域 ， 进 而 培 关 出 高 层次 的 思辨 技 
巧 ,与 (整合 性 的 思考 与 灌 通 ， 建立 解决 问题 的 衣 度 与 能 力 ( 品 学 党 文化 股份 

3 国立 豪 北 教育 大 学 通 识 教育 中 心 副教授 
bgp 传 大 学 资讯 管理 学 条 副教授 
SAAS RGR 
本 文 主要 作者 兼 通讯 作者 : tinatsai85@gmail.com 
2019/04/17 投 稿 ;2019/06/28 修 订 ;2019/07/18 接 受 
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有 限 公司 ， 和 无 日 期 )。 

近年 来 ， 教 育 部 积极 鼓励 大 学 校 院 强化 学 生 的 阅 蒜 理解 力 ， 提 升学 生 的 重 
HIHI O BSET > EHRE ° AE > PIREO R KRIA 
REEL ' H HARIAS pR ^ SEERA ET ^ REPAR 
EERIE « AATRE RS E tor EE AI E e 
EBJNES EIERNE > AOR AEE ^ AAT * HRES ELSA ER 
RR ^ ETE RARA ° 

此 外 ， MERZA RRA A Fs E eT GF 
Abe > 2015; PAE ` RER ` ARR * 2017; 陈 欣 希 等 ，2012 ; BRAA ， 
2015 ; pK > 2015; TE Hui > 2018 ; XE ` ZT2S A : 2013 ; BEAAM ， 
2018) > SXIBIERA EDS SRHUELTTIBSRUM > CERRI E E ns AE HJ ee f T m] üt LA 
ERRERA PAI ^ (ARN ^ HEA RIAA 9 CIE TH Se 
APAE Re AS ae (ARES A Fr BO AO ^ DASS SAT 
内 容 较 无 法 配合 需求 且 透 过 合 通 的 (多 样 化 ) FESS AE ^ FAS TE 
鼓励 学 生 於 上 课 前 巴 读 教材 内 容 、 上 课时 参与 议题 讨论 ， 因 此 如 何 使 教材 内 容 
能 透 过 适当 的 多 样 化 方式 传 愧 给 学 生 ， 以 增加 学 生 阅 芒 教 材 内 容 及 参与 议题 诗 
论 的 效果 ， 就 成 羽 翻 转 式 阅读 理解 课程 救 学 的 一 个 相当 重要 课题 。 

有 稚 於 此 ， 本 研究 自 106 学 年 度 第 1 学 期 (2017 年 9 月 ) 起 ,接触 了 新 发 展 
的 ePUB3 电子 书 强大 功能 技术 (International Digital Publishing Forum, 2017 ) * Pë 
和 转 将 所 任教 的 应 用 中 文 课程 部 分 教材 钠 作 成 ezPUB3 电 子 书 ( 蔡 姥 婷 ，2018a)， 
XR ePUBS3 RAFA CPESRBUEHBCR EX 8] > 2018) 进行 实务 教学 与 研究 工 
VE > DAR REE HI ePUB3 电子 书 於 应 用 中 文 课 程 的 教学 成 效 ， 站 得 到 初步 的 成 
果 : 加 写作 课程 的 ePUB3 电 子 书 翻转 式 学 虱 课 程 设计 与 教学 实务 成 果 ( 殖 嫉 
E RER ` IEP > 2019) ; CljePUB3 电 子 书 翻转 式 学 帮 模 式 的 课 前 预 落成 
效 分 析 (Tsai, Hsu, & Lin, 2019) ; 以 及 外 国文 课程 的 ePUB3 电子 书 混 合式 学 习 教 
案 避 计 及 教学 实践 成 果 ( 蔡 怒 婷 ，2018b，2018c )。 
基 论 过 些 成 果 “， 本 研究 除了 已 能 感受 应 用 ePUB3 ET EISER PERTEN 
教学 成 效 ， 但 对 於 应 用 ePUB3 电子 书 於 翻转 式 阅 革 理 解 学 避 课 程 ， 则 仍 发 现 目 
前 的 研究 成 有 果 尚 有 些 不 足 之 处， 原因 是 : BaP eR RE Be TE eB 
读 理 解 力 ， 因 此 课程 中 更 需 交 过 有 效 的 议题 计 论 ， 以 提升 学 生 的 重点 剖析 S$ 整 
合 其 释 、 踊 纳 应 用 等 能 力 。 然 而 ， 现 有 的 教学 和 经验 仍 反映 出 一 个 主要 问题 ， 也 
就 是 目前 的 课程 议题 讨论 人 以 一 般 的 小 租 讨论 方式 进行 ， 由 於 欠缺 有 效 引 导 或 
结构 性 说 题 ， 以 至 於 常 发 生 学 生计 论 时 漫 乱 章法 ， 或 讨论 时 缺乏 玩 辑 思维 ， 使 
讨论 无 法 得 出 有 效 铬 论 ， 从 而 降低 了 讨论 成 效 。 如 此 将 对 於 学 咎 文本 环 读 理解 
FINES ^ SECETEBUE SER HB RSS PERI © 
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因此 ， 本 研究 将 延续 已 有 的 ePUB3 电 子 书 研究 成 果 ， 人 针对 如 何 诱 使 学 生 
在 议题 讨论 时 能 更 有 成 效 ， 应 用 新 归 的 深度 讨论 法 ORE ^ 2017 ; HEF ， 
2018 ; Murphy & Firetto, 2017; Murphy et al., 2018; Quality Talk, 2012; Wilkinson, 
Soter, & Murphy, 2010) 於 ePUB3 电 子 书 翻转 式 学 性 模 式 ， 以 提供 更 加 完善 的 翻 
HS Bel aE ES Has» SEERA Se mE ^ Ue a AR are 
ee GE» CARIBE ILRI HH cham ^ HET ETT SAE Ye aE 
能 力 。 

因此 ， 本 研究 有 以 下 两 个 研究 问题 : 

研究 问题 1 : 应 用 深度 讨论 於 ezPUB3 电子 书 翻 转 式 天 苇 理 解 的 学 习 成 效 ， 
是 否 优 於 应 用 一 般 讨论 的 学 镁 成效? 

研究 问题 2 : 学 生 对 於 应 用 深度 讨论 从 cePUB3 电 子 书 翻 转 式 赔 苇 理解 学 性 
的 满意 度 角 何 ? 

和 名 了 有 验 症 上 述 两 个 研究 问题 ， 本 研究 将 针对 应 用 深度 言论 於 ePUB3 电 子 书 
WUSIDUSEPENRERTEDETTURERSKSI ' 使 课程 能 运用 深度 诗 花 的 优点 ， 改善 使 用 
一 般 讨论 的 问题 ， 增 加 学 生 天 证 理 解 能 力 的 学 名 成 效 及 满意 度 。 最 后， 本 人 研究 
将 运用 此 课程 设计 於 某 大 学 ' 阅读 教学 CREE! BOR 单元 的 实务 教学 与 成 
效 评 量 ， 世 轻 由 淮 实验 研究 法 的 实验 组 及 控制 组 对 照 分 析 ， 以 及 学 生 的 满意 
调查 ， 验 证 上 壕 的 两 个 研究 问题 。 

本 文 将 於 第 二 节 ， 什 对 本 研究 相关 文献 进行 探讨 。 第 三 节 将 介绍 研究 方 
法 ， 襄 明 本 研究 的 研究 设计 、 研 究 对 象 、 研 究 工 具 以 及 研究 流程 ， 其 中 研究 流 
程 骸 针对 应 用 深度 讨论 於 ePUB3 电 子 书 翻转 式 贱 读 理 解 学 炙 而 进行 的 课程 识 
工作 。 接 著 ， 在 第 四 节 ， 运 用 此 识 程 设计 於 实 务 教学 与 成 效 评 量 ， 六 透 过 淮 实 
验 研 究 法 的 对 照 分 析 “， 验 玫 本 研究 的 学 生 学 虱 成 效 及 满意 度 。 第 五 节 则 为 结论 
FARRAR REE ° 


KS 


二 、 文 献 探讨 


中 ePUB3 电 子 书 翻 转 式 学 习 

一 般 而 言 ， 混 合式 学 虱 blended learning; Bonk and Graham, 2006 ) AIME 
用 不 同 的 学 必 方 法 与 数位 科技 ， 使 学 虱 者 能 透 过 个 人 化 的 方式 进行 学 虱 。 也 由 
於 个 人 化 方式 学 如 的 成 效 普 汤 受 到 肯定 ， 因 此 混合 式 学 名 已 在 国外 成 惊人 备 受 瞩 
目的 学 虱 方 法 ， 且 有 效 提升 了 教 与 学 的 效率 (Alonso, López, Manrique, & Viiies, 
2005; Bersin, 2004; Thorne, 2003) )。 基 本 上 “， MMBC EBV RRS AK 
中 的 一 种 实施 模式 ， 因 此 也 常 被 称 为 翻转 模式 (Chen and Chen, 2014; Ram and 
Sinha, 2017; Wen, Zaid, & Harun, 2016) > HEB ASU : 运用 数位 科技 以 翻 
d LFERIHJERAESHAENDfGCA ^ SE RRR A ER RAA 
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内 容 ， 上 课时 再 针对 设 定 的 议题 进行 讨论 以 完成 学 慷 。 

此 外 ， 在 翻转 式 学 锦 活 动 的 进行 过 程 ， 数 位 教材 内 容 可 透 过 不 同方 式 传 授 
答 学 生 ， 例 如 动态 网 真 、 影 片 播 放 等 。 而 ePUB3 电 子 书 翻转 式 学 欠 即 为 一 种 过 
用 新 发 展 的 ePUB3 电子 书 技术 (International Digital Publishing Forum, 2017 ) 於 
翻转 式 学 性 活动 ， 合 学生 能 透 过 功能 强大 的 ePUB3 ETE > ETAR > 
是 讨论、 作业 徕 镍 、 成 就 测 驻 等 活动 ， 以 增进 学 生 的 学 名 意 顾 与 活动 参与 ， 进 
而 提升 其 学 性 成 效 。 具 体 而 言 ，ePUB3 电 子 书 以 近年 来 新 发 展 的 Web 2.0 技 术 为 
基础 ， 透 遇 HTML5、CSS、JavaScript 等 动态 互动 粤 标 准 规 格 机 制 (Mangiatordi 
& Scenini, 2017) > 不仅 能 提供 学 生 更 多 元 的 教材 内 容 传 泊 以 及 学 虱 活 动 进行 相 
关切 能 ， 更 能 透 过 其 强大 的 教材 阅 蒜 或 活动 参与 追 跳 功 能 ， 为 教师 提供 更 有 效 
率 的 教学 与 辅导 环境 。 

有 鉴 认 现 有 翻转 式 学 独 多 以 和 网 页 或 影片 做 为 教材 ， 而 学 独活 动 以 搭配 其 他 
数位 学 虱 平 台 如 Moodle、iLearm、Zuvio" 等 加 以 进行 ， 站 无 法 提供 学 生 整 合 且 便 
利 的 教材 内 容 传 收 以 及 学 独活 动 进行 相关 功能 ， 亦 无 法 内 助教 师 和 掌握 学 后 的 教 
材 阅 薰 或 活动 参与 情形 ， 以 通 时 和 给予 协助 或 辅导 “。 因 此 ePUB3 电 子 书 翻转 式 学 
尾 模 式 ， 已 开始 被 教育 界 所 重 秽 ， 以 期 竺 透 过 其 强大 的 功能 ， 提供 学 生 和 与 教师 
更 加 便利 与 更 有 效率 的 掌 恤 与 教学 环境 。 例 如 “， 洪 嘉 瑜 (2019 ) XEJHePUB3 E 
子 书 教 材 於 经济 学 课程 的 翻转 式 教 学 ， 以 创新 的 教材 内 容 及 教学 方式 ， 提 供 学 
生 优 质 的 数位 学 必 环 境 。 此 外 ， 本 研究 亦 应 用 ePUB3 电 子 书 翻 转 式 学 习 於 高 作 
课程 的 教学 ( 蔡 姥 婷 等 ，2019 ) * 站 经由 课程 设计 与 教学 实务 ， 以 验 诈 提升 学 生 
写作 能 力 的 成 效 。 

(=) CRE ait s 

PR RE at ii TE FAA AU A PIER FC TA a e 28$ [8] £2 281 GIRA * 2003 ; Abd-El- 
Khalick et al., 2004) RRE * 5 AREARE ^ GENE ^ uxal Uto ^ 
TESTED GERE SERERE ^ DUSHEEERAESEORH ATIS ER Be DUET NE 
(Edwards, 1997) ° PEATE SEB EO SC (Quality Talk, 2012) 
多 由 美国 各 级 学 校 的 推动 且 成 效 卓 车 (Murphy & Firetto, 2017; Murphy et al., 
2018; Wilkinson et al., 2010 ) 而 於 近 中 年 透 过 国立 台湾 师范 大 学 引进 政 进 行 研 究 
Ba HERS OREG > 2017; RUBUS ^ 2018) ^ WEARS MSN AR o PUM o RIK 
P$ BRIA ` PRE (2019 ) RE FH ZR FE a d i ES Oe C Dd eR RY d ia SE fy B 
HAUTE Slog > HERE PACS ^ ONES I VRBES eT A 
层次 思考 能 力 的 成 效 。 


https://moodle.org/ 
2 https://ilearn.bond.edu.au/ 


» http://www.zuvio.com.tw/ 
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深度 讨论 主要 在 强调 襄 话 与 讨论 是 促进 思考 的 重要 工具 ， 在 讨论 的 过 程 
中 ,不同 的 对 话 会 增强 不 同 的 证 知 与 思考 层次 ， 而 要 提高 学 生 参 与 讨论 的 意 
硕 ， 则 需要 管 造 出 通 宜 兰花 的 氛围 ， 因 此 透 过 以 学 生 为 主体 的 四 项 基本 要 素 : 
自主 众 释 与 掌控 主导 “请求 与 持续 机 制 、 预 读 文 本 与 深度 分 析 ， 以 及 基本 原则 
与 对 话 和 氛围 ， 以 增进 学 生 互 动 计 花 的 意 顾 ， 普 透 过 相互 引导 “合作 思考 ， 以 凝 
农学 生 持续 讨论 的 氛 团 而 得 以 最 后 提出 有 效 结论 。 


三 、 研 究 方法 


Fass 


C) Wt 

ATIC EPR al annie e PUB 3 E T E A cl a PS Raat EDA 
TESA CBS AY ePUB3 电子 书 翻 转 式 学 名 模式 及 基础 ， 另 外 再 针对 深 
度 讨 论 法 的 应 用 加 以 扩充 ， 使 课程 能 於 ePUB3 雷 子 书 翻转 学 虱 模 式 中 充 份 运用 
深度 讨论 的 相互 引 半 、 合 作 思 考 、 凝 从 氛 园 等 措施 ， 增 淮 学 生 深 度 讨论 以 及 解 
决 问题 的 效果 ， 以 提升 翻转 学 必 的 整体 成 效 ， 进 而 增进 学 生 重点 剖析 、 整 合 座 
释 、 如 物 应 用 等 能 力 的 培养 。 

有 关 实 务 瞪 谤 部 分 ， 本 研究 将 导 读 一 篇 倚 君 女士 的 散文 (放生 J。' 放生， 
选 自 母 心 似 天 空 ( 琦 君 ，1993)， 窜 的 是 琦 君 偶然 在 街头 看 见 巨 个 滞 人 贸 售 放 
E s IERI DNHIÉATUAE ^ RIPBESEKSREESEZUE SENE EIER * ERTrf 
AEG AS t EHS A BRE AY RE AU E ERAS ^ REE OB © BECAS ESE 
GKARGIEDIREEERAUAE ^ [ERU ACER IT ERST ^ SRA Se ASTE SER 
MES IL ^ ETRPRERBUHERSAOTER ES ok, T AES s 这些 回 慷 ， 使 
fut XC AGEN] FERE ZA BUTETR SR SERRE UK PEE QTE ^ RDRTSPREI— [HIE SEG 
BUE Se A ETE > SEP ESSA T RU REN 
HE > Sat reb Rz A ZI AE ^ EA AE EF 
TE > SEAR AE ln BES [EH AFER o AR > RRR A be 
THE QED ` SERB > 2009) 。 

AALEN mRAGE RK XB POTS > PRR ABER 
WAHIE > BR YARRA > BUENA A )e2s ^ EYP aI 
HME ^ HAHA ERNST SE > ULNDEEZAAK Loc AUTEM > 使 她 对 笔下 的 
KMEARREAD ^ SEBGRAN AS ` HERRANEN ^ ALA DI 
AGE > SAR REMHA ^ MARSH ERA ° fex 
文章 中 ， 除 了 文学 性 质 的 赏析 外 ， 可 做 为 议题 讨论 的 角度 相当 和 多; 从 宗教 角度 
看 ， 访 生 、 放 生 、 茹 素 等 生命 议题 ， 便 很 值得 深究 ; 从 环境 伦理 角度 看 ， 放 
生 行 为 是 否 得 当 、 法 令 制定 的 标准 ， 也 值得 深思 。 

本 研究 傈 以 前 后 测量 不 等 组 准 实验 设计 筷 主 ， 旷 以 封闭 或 问 卷 澜 查 及 开放 
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式 问 卷 调查 为 辅 ， 探 讨 应 用 深度 讨论 论 ePUB3 ET EMRA Bel a EEREER TER 
学 生 学 虱 成 效 及 满意 度 。 实 验 设计 模式 如 图 1 所 示 ， 其 
书 翻 转 式 学 镍 模式 下 ， 应 用 深度 讨论 於 天 读 理 解 学 炙 情 形 ， 实 验 租 探 用 实验 不 


H ePUB3 电子 


H > ThE TE e PUB3 Fa EMRAN BS BRE nS Poel SE ， 


而 控制 租 则 是 在 ePUB3 电 子 书 翻转 式 学 镍 模式 下 应用 一 般 讨论 方法 於 阅 读 理 解 


TUR o (REM Pa ball 


HS BY AE eR abe aT BC ^ T] RI DES BR 


读 理 解 学 名 的 学 生 学 名 成 效 课 前 测验 分 数 。 此 外 ， 图 1 的 "0 代表 实施 课 前 测 


验 ， 0, ,代表 实施 课 后 测验 ^ TX ,代表 进 行 实验 不 理 ， 而 -J 则 代表 未 进行 实 


BRASE o 


H 


INT KE 


ePUB3 E TEMBRA 
1 


.实验 组 ; 2. 控 制 组 


Zorn 
EA P ee A 
TET o aane O) ACERIN 
: 分 数 分 数 


HJ 
» 
青 形 


Ug 


Dg 


HAA 
Ped Fe Se FE 


C) WHITEY Be 


租 别 前 测 ”实验 处 理 U 
实验 租 O; X O, 
HAH O; 一 O, 
1 研究 架构 


本 研究 邱 用 淮 实 验 研 究 法 ， 有 运用 实验 组 及 控制 组 对 照 的 质 性 与 量化 分 析 ^ 


以 验 症 应 用 深度 计 论 


的 学 生 学 虱 成 效 ， 本 研究 有 以 下 研究 对 象 : 


1. 实验 和 组 ， 鸭 某 大 学 大 一 学 生 ，49 人 “， 年 龄 为 19 至 21 城 之 间 ， 访 班 学 生 
将 接受 以 深度 讨论 为 核心 的 ePUB3 电子 书 翻 转 式 学 虱 模 式 。 

2. 控制 组 ， 鸭 读 大 学 大 一 另外 一 班 学 生 ，42 人 “， SEHR INR 192821537 [8]. ， 
该 班 学 咎 将 接受 以 一 般 讨 论 航 核心 的 ePUB3 电子 书 翻转 式 学 和 模式 。 


3. 实验 组 与 控制 组 学 生 人 学 背景 、 分 数 、 全 


ile] EL PRA eke ^ LAL 


CAT HUS 
EROS ASA BCR * EY > i 


FE EPTHES BENT 


的 阅读 理解 先 备 知 


| ARES 
RBEJJ * (pee 
机 组 学 生 此 未 兽 有 翻转 学 


名、 深度 计 论 以 及 ePUB3 电 子 书 的 课程 或 使 用 释 验 “， 伴 於 高 中 时 期 有 过 


eR ET fay i EIR o 


SWALEH 


1. RRE FA AE TER EBS 
EU de LER a 


生 的 阅读 理解 应 月 


日 能 力 久 主 ， 因 此 我 们 以 一 题 应 用 型 


问答 题 : 琦 君 ' 放生 ,一文 所 描述 的 放生 事件 ， 时 序 和 心境 上 的 先 化 有 那些 属 


KR? 1 来 命题 


' ARIES e DURS 1 的 评 量 尺 规 做 为 评 量 标 
' 重点 剖析 J、' 整合 诠释 "BREA | 三 项 能 力 进 行 评 量 


t ^ St SREB AH 


ac Dort 
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Rl [放生 单元 课 和 后 测验 评 量 尺 规 

HE Rie 佳 可 RAE 

重点 剖析 (40%) 36-40( 完 全 掌握 ) 31-35 适当 掌握 ) 26-30( 部 份 掌握 ) 00-25( 欠 缺 掌握 ) 

HARRIE (30% ) 26-30( 极 为 精准 ) 21-25( 相 当 精 准 ) 16-20( 尚 属 精 准 ) 00-15( 欠 缺 精准 ) 

BEREI (30%》 26-30( 酸 为 完整 ) 21-25( 相当 完整) 16-20( 尚 局 完整) 00-15( 久 缺 完整 ) 
规 的 稳定 性 ， 本 研究 以 15 位 曾 修 过 本 课程 的 学 生来 进行 检测 ， 店 由 笔者 以 及 其 
他 两 位 曾 教授 过 此 课程 的 教师 根据 评 量 尺 规 进行 评分 ， 接 著 再 以 肯 德 页 W 检定 
(Kendall’s W Test ) Ae az — (i An (Scorer Reliability )。 根 据 表 2 的 
SS W 检定 结果 可 知 ， 在 ' 重点 剖析 ^T ARTE ET 中 秽 应 用 ,三 个 项 目 
E  NoERCEIBEUINIS.05 ; 因此 “在 显著 水 淮 为 .05 的 情况 下 ， 此 评 量 尺 规 在 
三 位 评分 者 问 具 有 显著 稳定 性 。 

表 2 Mi e | 单元 课 和 后 测验 评 量 尺 规 
平分 者 闻 信 度 之 肯 德 需 W 检 定 结 果 
内 容 掌握 度 MAAE REE 


因数 3 3 3 
Kendall’s W 检定 ? .744 .630 568 
KA 31.237 26.455 23.842 
自由 度 14 14 14 
渐 近 显著 性 .005 .023 048 


广 : “Kendall MIZE (38 


2. 问卷 调查 

针对 学 生 对 於 本 课程 的 满意 度 调查 ， 本 研究 於 实 验 租 上 课 和 结束 和 合 ， 以 问 
卷 调 查 方式 进行 。 此 问卷 调查 针对 ePUB3 电子 书 翻转 式 学 各 以 及 深度 讨论 的 使 
Hj: HERTA SGEDSEPETERH GFR” Q1 8 Q8) : BATRA: (1) 使 用 

A3 【放生 1 单元 问卷 调查 题目 
问题 性 质 问题 内 容 
Ql. PH ERU STURM ,使 用 ePUB3 志 子 书 翻 转 式 学 如 
式 上 课 :是否 让 你 觉得 BEARR? 
ENI ERAEN ， 使 用 ePUB3 Lee ann 
Be 


AE e AR f EDR ^ PERE 
ME pest rali LAE ? 
传统 的 上 AHAA S 使 用 ePUB3 电 子 书 翻转 式 学 匀 
式 上 课 ， 是 否 更 能 提高 你 的 学 习 意 左 ? 

传统 的 讨论 方式 比较 ， 使 用 深度 齐 论 法 进行 分 租 衣 
| 是 否 访 你 必得 更 能 持 转 进行 讨论 以 得 出 有 效 辕 论 ? 
熏 入 的 讨论 方式 比较 ， 使 用 深度 讨论 法 进行 分 租 计 
Ev d 觉得 更 以 你 为 核心 、 提 供 你 更 能 自己 掌控 
半 讨 论 进 行 的 环境 ? 


B 


使 用 
ePUB3 电子 书 
MENSA Q2 


Q3. 


Q4. 


合用 
深度 计 论 


(5. 


2a Sal Bb Sal nm Mr nes 


XE 


J 


Wu MW 


ate RUP 


Q6. 


整体 Q7. 
满意 度 


统 的 讨论 方式 比较 ， 使 用 深度 讨论 法 进行 分 租 计 
ay Efe (RAHN AG ? 

统 的 上 课 方 式 比较 ， 你 是 否 更 满意 使 用 以 深度 讨论 
心 的 ePUB3 E TERRAE ER? 
统 的 上 课 方 式 比 较 ， 你 会 优先 址 择 探 用 以 深度 讨论 
LM ePUB3 电子 书 翻 转 式 学 名 模式 上 上 课 的 课程 吴 


Q8. 
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ePUB3 志 子 书 翻转 式 学 必 ; (2) 使 用 深度 讨论 ; (3) 整 体 满 意 度 。 而 尺 规 部 分 则 探 
用 7 等 级 的 李 克 特 量 表 (Likert scale) > 其 中 最 低 等 级 为 非常 不 好 1 (44057) » 
而 最 高 等 级 局 和 非常 良好 (得 6 分 )。 此 外 ， 本 研究 也 於 问 卷 调 查 题 目 之 和 后， 
留 有 文字 回馈 匣 域 ， 以 鼓励 学 生 提 供 学 必 心 得 与 感想 的 文字 性 竹 述 。 


四 研究 流程 

由 於 本 研究 以 应 用 深度 讨论 於 ePUB3 电 子 书 翻转 式 赔 读 理 解 学 习 朋 核心， 
因此 研究 流程 将 以 运用 ePUB3 志 子 书 翻转 式 学 避 模 式 久 基础 ， 另 外 再 针对 深度 
讨论 法 的 应 用 加 以 扩充 ， 而 有 以 下 四 个 阶段 的 课程 设计 工作 ( 此 设计 以 完成 应 
用 深度 讨论 於 ezPUB3 电 子 书 翻 转 式 国 读 理解 学 镍 的 课程 实施 角 目 的 ， 自 确认 辣 
许 理 解 课程 的 学 虱 目 标 及 教学 策略 开始 ， 轻 由 学 虱 活 动 的 规划 以 及 电子 书 教 材 
的 禹 作 ， 於 完成 实际 的 授课 各 评 量 合 结束 )， 效 分 述 如 下 : 

1. 确认 阅读 理解 学 习 目 标 及 教学 策略 

一 般 而 言 ， 教师 在 设计 课程 活动 及 抽 作 教材 之 前 ， 应 移 确 就 此 课程 的 学 避 
HE ^ Wa Se Peet Be RR TAR ^ Dia thi GS ia 
BMA o ARAETA Be ae REE Ei * BEHEA ey cE 
AYP ^ Digest SERVE ROT ^ GRRE ^ BAER * KEZ 
fiti n iS bs Be AE HUS EG AREI ae TS EVER : (1) 重 点 剖析 : 找 出 文章 
ER c faSRE Ra BGS ACE ; (ESETE: AE EER EAH ^ DARGUR 
扼要 语句 重新 表 迷 ; (GEEH : 具备 有 效 赔 读 、 创 新 运用 的 能 

根据 学 性 目标， 教师 接著 即 可 订 定 出 项 迷 成 此 目标 而 将 探 行 的 教学 策略 。 
具体 而 言 ， 教 学 策略 可 透 过 以 下 各 项 目的 纤 合 还 用 而 加 以 让 定 : 教学 方法 (如 
直接 教导 x EEE Roca ) ^ 教学 方式 (如 集体 、` 小 组、 个 别 方 式 ) ' 以 及 教 
学 活动 (如 教材 自学 、 教 材 讲解 、 专 题 措 作 、 问 题解 决 ) SAH CREDERE » RE > 
蔡 溢 ，2012 ; Merrill, 1994) )。 因 此 ， 以 贱 读 理解 课程 而 寞 ， 教 师 可 根据 ePUB3 
电子 书 翻 转 式 学 必 模 式 ， 订 定 以 下 教学 策略 : CARER ERE BO 
自学 )， 上 识 时 教师 集体 教导 (教材 讲解 ) 以 及 学 生 小 租 讨 论 CERTE) > 以 透 
过 多 元 化 的 翻转 学 避 活 动 ， 过 成 塔 辩 学 生 半 苦 理 解 力 的 目标 。 

2. 规划 阅读 理解 学 习 活 动 

此 规划 可 透 过 以 下 经 项 工作 完成 : 

(1) 依 据 教 学 策略 ， 决 定 课程 的 各 个 学 性 活动 。 由 於 在 ePUB3 电子 书 翻 转 式 
学 匀 模 式 下 ， 课 程 进 行 是 以 学 生 国 主体， 因此 教师 可 依据 教学 策略 所 订 定 的 教 
学 活动 ， 加 上 必要 的 测验 评 量 活 动 ， 决 定 以 下 课程 学 必 活 动 :a. 上 课 前 学 生 个 
别 牧 上 预 芒 教材 ， 以 建立 阅读 理解 概念 b. ESRPHARESEER E T8 Use f TR HU UR 
(前 测 ) 以 评 量 学 生 阅 翘 理 解 概念 ; c. 上 课 期 间 教 师 根 据 学 后 阅 读 理 解 概 念 ， 进 
行 教材 内 容 集体 讲解 ; d. 上 课 期 间 学 生 透 过 天 读 理 解 议题 小 租 计 论 > 以 深化 阅 
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文思 考 与 训练 ; e. 上 课 络 束 时 学 生 个 入 进行 课 合 测验 ( 合 测 ) Dba IE PS RRE 
解 学 虱 成 效 


(2) 依 据 深度 诗 论 法 的 特性 ， 训 计 上 述 d 小 和 组诗 论 活动 内 容 。 一 般 而 言 ， 深 
度 讨 论 法 强调 运用 互动 问答 及 合作 解 题 等 做 法 ， 以 增进 学 生 的 参与 诗 论 意 顾 ， 
强化 其 凝 窜 共识 以 得 出 有 效 精 论 的 能 力 。 因 此 ， 教 师 可 依据 深度 讨论 法 强 衣 的 
做 法 ， 加 上 必要 的 分 享 评 量 活动 ， 裔 计 以 下 的 小 租 深度 讨论 活动 内 容 : a. 计 论 
前 教师 解 襄 讨 论 过 程 ， 茸 要 求学 生 进 行 提问 徕 和 名， 以 透 过 深度 讨论 法 强调 的 提 
出 问题 (如 文本 探究、 情境 假 设 、 轻 验 分 享 `、 新 知 探讨 等 问题 ) 回应 问题 (如 提 
出 支持 性 了 延伸 性 了 批判 性 回应 )、 提问 与 回应 循环 等 措施 ， 增 强 学 生 的 证 知 
BUS vni SEJEEBB ; b. vamp Aa AE St 
对 教师 提供 的 讨论 题目 进行 组 内 深度 言论 (包含 前 述 的 各 式 问 题 提 出 、 文 持 性 了 
延伸 性 一 批判 性 回应 、` 提 问 与 回应 循环 等 活动 ) ; c. 讨 论 期 间 学 生根 据 提问 与 回 
应 循环 活动 成 果 “' 进行 结论 推荐 、 验 证 、` 提 出 等 活动 ; 由 於 学 生 已 所 有 认 知 与 思 
考 的 经 验 ， 加 上 深度 讨论 鼓励 的 分 享 想法 、 假 设 探讨 、 提 供 佐 考 、 挑 战 葵 点 等 做 
法 ' 因 此 可 协助 学 生 凝 聚 持 德 诗 论 的 氛围 而 得 以 最 和 后 提出 有 效 络 论 ; d. 计 论 结 
束 时 学 生 进 行 跨 租 和 结论 分 享 、 相 互 评 论 等 活动 ， 教 师 六 答 予 评语 及 建 戟 ， 以 提 
供 学 生 自 我 评 量 与 省 思 的 参考 。 

(3) 依 据 前 述 学 必 活 动 的 规划 “， 考量 各 活动 进行 所 需要 的 教材 ` 时间 、 资 源 
(如 特殊 设备 ` 教 学 助理 等 ) ^ 将 学 虱 活 动 详细 规划 完成 ( 共 裔 计 有 六 个 学 各 
动 ， 如 表 4 所 示 )。 


TH 


kA 课程 学 习 活 支 


翻转 式 混合 学 名 活动 ”活动 内 容 活动 期 限 ”_ 活动 时 间 

A1 HRA ECE (aR ERA ERRAI 7 天 

A2 课 前 测验 学 生 个 列 课 前 测验 上 课 开 始 时 5 分 链 

A 3 RAO 教师 集体 讲解 教材 内 容 EERE 1053 $i 
EAE (a EBA 

A4 小 租 讨论 ERA ENDE TT TET 上 课 期 间 205$ 
学 生 小 租 深度 讨论 305158 

ASA SEHE 全 班 公开 分 享 及 互 评 ” 讨 花 糙 束 合 305$ 

AEM Fits Se t 
A6 TER Ce RUD: FRE (IS s Cie EU LRG 154r 


AA HRAM : EATARRA ^ FEWR EHR ePUB Aaa BUA >, DARE 
TEP ELPA ° 

AA ” 课 前 测验 : LSRDHARRE > 82427 ePUB3 BEF SERN BET 5 RT 
测验 (前 测 > DAPESEERAIEBSSETERETSUS. o 

A3 讲解 教材 : 上 课 期 间 ， ZRDARIEBUIURG ARSENY E Bua PE Bian > aE 
fT 1077 SAU ALAS SS GERE ^ SAE EA RE (Hl a! Baa eP UB 3 ETEA 
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AA 小 租 讨 论 : Tel ^ SRTENRIRZXHUIHAEAIAH Beam» 35115022 38 


PR avin ^ DUATEBISBUS HS EHBERE 


TER - LENS NDIA : 


a ACA ARAN AMER ^ YU ESGKERAGETTDEEN BRE ^ DUR EE ae ATE 


TARE ; b. 学 生 人 针对 教师 提供 的 讨论 题目 ， 循 环 进 行 租 内 辣 题 提问 与 回 


应 ; c. 学 生根 据 提 问 与 回应 循环 活动 成 果 “， feum ^ Be ^ Der 。 


AS 分 享 互 评 : 讨 花 结束 后 ， 学 生 进 行 30 


分 甸 跨 组 结 花 分 享 、 相 互 评论 成 


A c 教师 站 给予 评语 及 建议 ， 以 提供 学 生 自我 评 量 与 省 思 的 参考 。 


AG BRENS : 上 巢 千 束 时 ， 学 生 认 ePUB3 电 子 书 测验 本 个 别 进 行 15 分 链球 
后 测验 (后 测 )， 以 验 束 阅读 理解 的 学 必 成 效 。 


3. RR TREBHSEEPRERS SAA 
HIA 4E ePUB3 电子 书 翻转 式 学 必 模 式 下 
8BLCA.1) RATUR CA 2) * iane CA 3) 


> ePUB3 电子 书 用 於 课程 的 笋 上 预 
`、 课 后 测验 (A.6 ) 等 活动 ， 因 此 电 


子 书 的 设计 将 以 配合 过 些 学 必 活 动 的 进行 为 核心 ， RES SA AHA ER Baw 


RL ^ uf SEA LIB CAL 1 的 需要 、 


WITE ^ SESH AY ePUB3 ET SRE ia SE * Die RS aw o 
建立 学 生 的 阅读 理解 概念 ，ePUB3 


电子 书 教材 需 适 当 的 将 重点 剖析 、 整 合 诠释 、 锯 纳 应 用 等 相关 内 容 按 顺序 篇 


排 ， 半 透 过 实例 解说 以 过 到 学 生 自 行 预 莉 即 可 建立 阅读 理解 概念 的 目标 。 
在 完成 上 述 ePUB3 电子 书 教 材 内 容 设计 和 合 ， BEB RIA TI SAAN 
(RD React ^ Hi ePUB3 电子 书 技 术 提 供 非常 丰富 的 内 容 传 玩 功 能 ， 例 如 影 


KDE SSG FR aS 


> AUC ACAI EH He ne te tt 


吸引 学 生 阅 读 、 增 进 内 容 了 解 、 配 合 学 虱 活 动 的 电子 书 教 材 。 
最 人 后， 在 完成 ePUB3 电 子 书 的 教材 内 容 以 及 传 玩 功能 朗 计 人 后， 即 可 透 


过 适当 的 开发 工具 将 此 电子 书 扫 作 完 成 。 目 


前 有 关 ePUB3 电 子 书 册 作 ， 已 有 


许多 可 行 的 开发 工具 ， 例 如 ViewPortert、InDesign”、Sigil6、Calibre" 等 ， 其 中 以 
Viewporter 最 饲 通行， 叙 作 出 的 电子 书 品质 也 相当 受 好 评 。 图 2 及 图 3 入 本 研究 


有 还 用 Viewporter 而 购 作 完成 的 放生 | ePUB3 8 


E 子 书 教材 部 分 内 容 。 


http://viewporter.com 

2 http://www.adobe.com/in/products/indesign.html 
n https://github.com/Sigil-Ebook/Sigil 

1 http://calibre-ebook.com/ 
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放 生 $ 生平 介绍 


A ge 琦 君 , 原名 潘 希 珍 ， 大 学 蛙 自 唤 AB, 取 希望 丰 
@ ma ma T 的 涵 闵 。 笔 名 来 自 两 位 恩师 夏 承 可 - EKA AHO 


"稀世 珍 琦 ， 及 上 琦 君 , ， 便 以 此 作为 笔名 。1917 年 出 生 於 
有 一 天 走 在 衡阳 路 ， 看 见 一 群 人 图 在 街角 看 热 并, 有 目 浙江 省 永嘉 又 ， 杭 州 之 江 大 学 中 文系 办 业 ，1949 年 随 国民 党 
WEFR  AWERER > a : 政府 渡海 来 台 ， 曾经 担任 历任 高 检 卡 记录 股 长 、 司 法 行政 部 
我 猜想 一 定义 是 那个 无 奈 的 母亲 ， 展示 她 头 大 如 斗 ， 编 害 科 长 、 中 央 大 学 兼任 教授 等 职务 ， 后 来 定居 美国 专职 富 
REES - 以 博取 过 往 行人 的 同情 。 作 ， 亲族 2005 年 夏天 回 台 定居 ，2006 年 6 月 7 日 因 肺 炎 病 
我 已 经 在 不 同 的 地 点 看 到 过 雨 三 次 ， 纺 是 匆匆 向 地 上 HRA. 
AFBET MAR LADRA 。 = 
= tp 32 T i— - 4 — 
ne SE E EA n CH xt as 琦 君 的 散文 舒 放 自如 、 平 实 近 人 “淡雅 而 风味 信永 ， 是 
SEE HIR. 许多 人 从 小 到 大 阅读 的 记 昼 ， 曾 区 中 山 文艺 奖 、 新 闻 局 优良 
一 个 壮 健 的 男人 ， 各 手 插 腰 ， 额 上 冒 著 汗 珠 ， 口 沫 飞 著作 金 易 奖 、 国 家 文艺 奖 等 等 ， 阅 读 琦 君 作品 ， 仿 乔 品 当 芳 
溅 地 大 声 鸣 喝 著 : 上 做 好 事 哦 ， 哪 一 个 买 了 去 放生 做 好 事 ENSE EX SuSE BAVA A aR 
LM = KAR: MES UTRA  LEERREORR EA 
单元 学 习 目 标 SERNA SESAME RIM RIRE 
BA REEDTZ /'i SERMONE) 一 .Sr 喜爱 ` " 
1. RES3CAK E - BER IE RODEO RCEUD AR. WEBER va v 
女士 温润 宽厚 的 笔调 。 & C 
2. TRRBX AOI REESE - E 
3. BALES SER RUN GIA - 逆 能 提出 自己 的 看 法 。 点 * 
2 wl 3 


图 2 “上 放生 ，ePUB3 志 子 书 教材 示例 人 : SHAH: ANB BPH 


i 


Y 1 T T 1 f Y 1 


| 
| 
| 问题 与 讨论 


BRERA 一 、 本 文 由 街头 大 钨 遭 人 放生 ， 联 想 过 去 诸多 类 似 的 放生 回 


请 看 完 以 下 影片 后 ， 至 讨论 区 去 表达 你 的 意见 。 懂 ， 行文 之 中 给 你 何 样 的 感受 ? 


3. 


BR AAR IG) BAN A OR A) 
二 、 你 对 放生 的 看 法 如 何 2 你 赞成 放生 吗 2 


三 、 你 对 吃素 何 有 看 法 ? 有 些 人 士 主张 吃素 可 以 做 环保 、 爱 
地 球 ， 你 的 观点 如 何 ? 


四 、 宗 教 的 目 是 使 人 心安 ， 你 有 任何 宗教 信仰 吗 2 有 没有 和 藉 
助 宗教 力量 解决 问题 的 经 验 ? 试 著 分 享 出 来 。 


影片 来 原 : youtube 


v 


* x 
{ 
4 | 


图 3 “放生 ,epPUB3 志 子 韦 教材 示例 口 : 影片 播放 、 疯 点 话题 、 问 题 讨论 
4. 阅读 理解 课程 授课 与 评 量 
在 完成 ePUB3 电子 书 教 材 的 奥 作 后， 接著 即 可 进行 此 阅 薰 理解 课程 的 实务 
教学 与 成 效 评 量 。 此 阶段 工作 可 於 排 定 的 课程 日 期 ， 依 据 前 述 规 划 好 的 学 慷 活 


Hy CZ 


| 


ASI A. 1 35 A6) + XB e PUB3 E TEACH BE RTI 


成 各 活动 所 规范 的 学 习 工 作 。 至 於 课程 的 成 效 评 量 部 分 :'; BUSTA BREAN SCAT 
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提出 的 两 个 研究 问题 ， 将 首 移 透 过 淮 实 验 研 究 法 的 实验 和 组 及 控制 组 对 照 分 析 ， 
以 验 诈 应 用 深度 讨论 从 ezPUB3 电 子 书 翻 转 式 阅 访 理解 学 性 的 学 生 学 贸 成 效 ( 研 
完 问题 1 ) > 接著 透 过 实验 组 学 生 的 注意 度 问 卷 调查 ， 以 了 解 学 生 对 课程 的 满意 
度 〈《 研 究 问题 2)。 


四 、 翻 转 式 阅 诈 理解 学 习 课 程 实 务 教 学 与 成 效 评 量 


在 提出 应 用 深度 讨论 於 ePUB3 电子 书 翻 转 式 阅读 理解 学 锤 的 课程 设计 人生 ， 

本 研究 接 下 来 即 运 用 此 课程 设计 於 某 大 学 ' 阅 芒 教学 ,课程 ' 散文 选读 "放生 ， 

单元 的 实际 教学 与 评 量 。 本 季 先 於 第 一 小 节 襄 明 "' 放生 a 单元 的 学 虱 活 动 及 教材 
内 容 ， 第 二 小 节 和 与 第 三 小 节 则 分 别 介 绍 此 单元 的 实务 教学 与 成 效 评 量 ， 最 后 论 
第 四 小 节 作 对 研究 千 果 进行 讨论 


CJ 放生 单元 学 必 活 动 及 教材 内 容 

依据 前 述 课程 设计 第 二 阶段 所 规划 的 学 贸 活 动 (如 表 4 所 示 )， 本 单元 识 
有 六 个 学 名 活动 ， 而 ePUB3 Pe AM Naat EYE ^ NACA e BIER ENS 
动 的 进行 房 核心 ， 使 教材 内 容 能 於 活动 进行 时 ， 透 过 通 当 方式 传授 给 学 生 。 例 
如 ， 如 图 1 及 图 2 所 示 ，' 为 了 配合 学 生 预 车 教材 (A.1) 的 需要 “， 教材 的 设计 即 
以 运用 影片 播放 、 语 音 半 雍 等 生动 方式 ， 以 增加 学 生 的 阅读 风趣 。 此 人 外， 教材 
中 也 加 入 观 点 话题 及 问题 计 花 等 内 容 ， 以 引导 学 生 的 阅 攻 思 考 与 理解 训练， 使 
学 生 能 透 过 自行 预 读 即 可 建 并 阅读 理解 概念 。 


CJ 放生 , 单元 课程 实务 教学 

在 进行 课程 实务 教学 前 ， 本 研究 首先 针 针 成 效 评 量 部 分 ， 裔 计 以 下 两 项 
评 量 工作 : 1. 准 实验 研究 法 的 实验 租 及 控制 租 对 照 分 析 ， 验 证 应 用 深度 讨论 於 
ePUB3 电子 书 翻转 式 开 读 理 解 学 性 的 学 生 学 镁 成效 ，2. 厌 问卷 调查 了 解 实 验 租 
学 生 对 课程 的 满意 度 。 本 研究 以 前 述 的 研究 对 象 为 基础 ， 於 107 学 年 度 第 1 学 期 
(2018 ) 11 H 13 日 上 午 进行 探 用 深度 讨论 的 实验 租 实务 教学 ^ 於 11 月 16 日 下 
午 进 行 探 用 一 般 讨 论 的 控制 组 实务 教学 ， 以 表 5 做 为 此 实验 组 及 控制 组 实务 教 
学 的 学 习 活 动 规划 “， 以 表 6 做 如 学 必 活 动 的 小 租 讨论 进行 规划 。 程 序 上 ， 於 上 
课 前 一 过， 对 实验 租 班级 介绍 以 深度 讨论 及 核 心 的 ePUB3 ET SS TE E 
式 (A.1 至 A.6 学 虱 活 动 )、 深度 讨论 进行 方式 (如 表 6)， RRL al FRAT 
天 内 ， 需 完成 A.1 学 灵活 动 。 两 班 於 正式 上 课 并 始 时 均 进 行 表 5 之 A.2-A.6 学 狠 
活动 。 居 提高 分 租 讨 论 效 果 ， 本 研究 探 随机 分 租 方 式 、 每 租 4 至 5 位 学 生 ， 进 
行 深度 讨论 ， 於 讨论 和 络 束 后 进行 全 班 分 享 及 相互 评论 ， 东 由 教师 讲评 及 建 广 。 
最 和 后 ， 於 上 课 和 结束 时 进行 课 和 后 测验 ， 验 访 学 虱 成 效 。 
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5 实验 组 及 控制 组 实务 教学 学 习 活 动 规划 


学 性 活动 名 称 实验 组 控制 组 
A.1 预 广 教材 ePUB3 E T-HAAUM ePUB3 电子 书 教材 
A.2 课 前 测验 (两 租 相同 问题 ) 接受 BESS 
A^ 3 ABO 接受 接受 
A4 小 租 讨论 深度 讨论 一 般 计 论 
A5 分 享 互 评 接受 aa 
A.6 课 和 后 测验 (两 组 相同 问题 ) 接受 接受 
表 6 实验 组 及 控制 组 实务 教学 小 组 讨论 规划 
BEST aE BD EE owe 
教师 提供 讨论 题目 (两 组 相同 题目 ) 实施 实施 
BAP SE PES (PRIS) ”实施 不 实施 


学 生 组 内 提问 、( 支 持 /延伸 /批判 ) 回 应 “实施 不 实施 
ESBS EE CE EA 实施 不 实施 
生 跨 组 结 葵 分 享 、 相 互 评 草 成果 ”实施 实施 
此 外 ， 作 针 控 制 组 班 航 ， 也 於 前 一 通 下 麻 前 ， 对 学 生 介 绍 第 二 遇 上 商 进 行 
模式 ， 也 要 求 第 二 再 上 课 前 7 天 内 ， 需 完成 ePUB3 电 子 书 教材 预 读 ， 政 於 第 二 
肖 上 课 开 始 时 先进 行 课 前 测验 ， 了 解 预 诸 成 效 ， 於 上 课时 根据 前 测 结 果 讲 解 教 
材 内 容 ， 根 据 教 师 指 定 分 租 及 讨论 题目 ， 有 运用 一 般 讨论 方式 ， 最 合 於 上 课 千 束 
时 进行 课 后 测验 ， 验 证 学 习 成 效 。 
最 俊 ， 人 针对 上 课时 的 议题 讨论 部 分 ， 实 验 租 使 用 深度 讨论 法 进行 50 分 钙 小 
租 讨论 ， 控 制 租 亦 同 ， 惟 使 用 一 般 讨论 进行 。 首 先是 20 分 鱼 提 问 彝 居 ， 透 过 文 
本 探究 、 人 情境 假设 、 自 身 感受 、 和 色 验 分 享 、 新 知 探讨 等 问题 ， 以 及 提出 支持 
性 、 延 伸 性 、 批 判 性 回应 的 循环 活动 ， 增 强 学 生 的 认 知 与 思考 练 必 ,提高 学 生 
后 绑 参 与 议题 讨论 的 能 力 与 意 硕 。 以 下 列举 部 分 问题 提问 与 回应 的 练 必 内容 ， 
以 ' 租 别 J-' 序 号 J 表示 学 生 篇 号 。 
2-1 : 如果 在 路 遵 看 见 有 人 正在 贩 训 放生 岛 ， 该 怎 床 探 取 行 动 呢 ?《〈 人 情境 假 
设 型 问题 ) 
2-2 : 假如 陵 到 家 和 里 长 理 准 备 购 圈 动 物 放 生 ， 该 怎么 跟 他 潢 通 《情境 假设 
型 问题 ) 
2-3 :你 觉得 那些 麻 省 ， 被 抓 来 拉 在 小 小 的 入 子 里 ， 有 什么 感觉 呢 ? CH 
身 感受 型 问题 ) 
2-4 :从 生物 与 环境 的 关 傈 来 看 ， 你 会 支持 放生 吗 《文本 探 完 型 问题 
2-5 :在 过 去 读 遇 的 文章 中 ， 是 否 有 类 似 行 为 的 爷 述 亡 〈 新 知 探讨 型 问题 ) 
2-1 :我 觉得 你 的 说 法 很 有 道理 。( 支 持 性 回应 ) 
2-2 :除了 这 些 让 据 以外， 我 还 有 想到 另外 一 个 例子 。( 延 伸 性 回应 ) 
2-3 : 这 个 说法 不 是 不 行 ， 但 是 … o 批判 性 回应 ) 
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在 完成 提问 和 红 属 和 后， 学 生 接 车 针对 教师 提供 的 讨 花 题目 进行 30 分 甸 租 内 深 
度 讨论 ， 斑 於 猪 束 时 提出 结论 ， 以 做 局 合 续 跨 租 分 至 及 相互 评论 的 依据 。 以 下 
怖 教 师 提 供 的 讨论 题目 :看 了 放生 5 一 文 后 ， 你 对 於 人 们 了 放生 5 的 作 局， 


有 什么 感受 ? 5 而 各 组 学 生 即 以 问题 为 核心 ， 进行 组 内 问题 提问 与 回应 的 循环 
活动 ， 以 下 列 肉 部 分 问题 提问 与 回应 的 循环 式 诗 论 内 容 ( 以 ' 组 别 ,- ' 序号, 表 


示 学 生 篇 号 ) : 


1-2 :在 你 们 届 遭 有 哆 过 有 人 做 过 放生 这 种 事 嘴 ?新 知 探 夺 型 辣 题 ) 

1-3 :我 想到 以 前 我 九 嬉 也 请 急 贩 扩 她 订 急 ， 她 就 骑 机 车 去 水 库 放 。( 延 伸 
性 回应 ) 

1-4 : 我 觉得 为 什么 人 类 总 是 站 在 自己 的 角度 去 做 事 ， 想 想 这 样 对 鱼 好 吗 P 
(批判 性 回应 ) 

1-1 : 琦 君 女士 看 到 能 里 的 麻 稚 很 可 懂 ， 若 是 你 们 是 那些 麻 举 ， 有 什么 感 
党 呢 ? (自身 感受 型 问题 ) 

1-2 :当然 痛 得 要 命 呀 ! 被 天 的 、 被 折断 翅膀 的 可 不 是 那些 高 高 在 上 的 人 类 
呀 。( 文 持 性 回应 ) 

1-3 :假如 不 以 宗教 目的 来 看 放生 仪式 ， 和 从 生物 与 环境 的 关 傈 来 看 ， 你 会 
支持 放生 吗 ? 《情境 假设 型 问题 ) 

1-4 :当然 不 会 ! 放生 会 造成 环境 食物 链 的 破 款 ， 也 对 生物 让 应 不 良 。( 延 
伸 性 回应 ) 

1-4 : 提 倡 放生 是 一 件 没有 意义 的 事 ， 没 有 抓 走 这 些 动物 ， 就 没有 放生 的 
E o 延伸 性 回应 ) 

1-2 : 该 怎 床 拯 救 那 些 被 放生 的 生物 ”阻止 那些 不 明智 放生 的 人 ?上 《批判 性 
回应 ) 

1-3 : 举 发 金额 提高 ! (支持 性 回应 ) 

1-1 : 请 政府 清查 动物 买 献 帐 目 ， 或 立法 保护。 文 持 性 回应 ) 

1-4 :让 里 民 自 发 性 查核 及 纠 举 o (FEBE ) 

1-1 :要 是 已 经 放生 了 “， 该 怎 床 处 理 后 续 发 生 的 问题 ”(〈 情 境 假设 型 问题 ) 

1-2 : 把 物 捞 起 来 ， 处 理 忽 的 属 体 。( 支 持 性 回应 ) 

1-3 :让 大 自然 分 解 忽 吧 ! (支持 性 回应 ) 

此 外 ， 各 粗 的 讨论 过 程 ， 均 要 求 其 中 一 位 学 生 凶 音 普 事后 做 成 简要 文字 记 


钞 。 在 完成 小 租 深度 讨论 合 ， 全 班 学 生 和 进行 30 分 键 的 跨 租 分 享 及 相互 评论 ， 以 
深化 性 题 诗 论 的 效果 “站 由 教师 给 予 讲 评 及 建议 ， 以 提供 学 生 自我 评 量 与 省 思 


的 参考 。 


C 放生 ,单元 课程 成 效 评 量 
1. 实验 组 及 控制 租 学 习 成 效 对 照 分 析 


在 分 别 完 成 实验 组 及 控制 组 的 实务 教学 后 ， 两 租 均 透 过 15 分 甸 的 课 合 测 
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验 ( 实 验 租 49 人、 控制 租 42 人 完成 测验 ) ^ 以 验证 学 生 的 学 习 成 效 。 由於 后 
测 以 验证 学 生 的 阅读 理解 应 用 能 力 角 主 ， 因 此 我 们 以 一 题 应 用 型 问答 题 : ! 琦 
君 " 放 生 "一文 所 描述 的 放生 事件 ， 时 序 和 心境 上 的 释 化 有 那些 层次 ? BR eT 
E ^ XE EU e DAE ER Us E Eae (如 表 1 所 示 )。 忆 了 验 茜 实验 租 的 学 
老成 效 是 否 优 於 控制 组 ， 本 研究 提出 以 下 的 研究 假设 : 於 egPUB3 电 子 书 翻 转 
式 学 虱 模 式 下 ， 应 用 深度 讨论 於 关 读 理 解 的 学 虱 成 效 优 於 应 用 一 般 讨 论 的 学 性 
成 效 。。 由 於 此 课程 要 求学 生 於 课 前 预 攻 教 材 ， 但 学 生 预 攻 的 覆 悍 与 成 效 有 所 
不 同 ， 因 此 有 可 能 影响 到 课程 的 最 终 学 生 学 虱 成 效 。 筷 了 排除 不 同 的 课 前 预 
DCCA TA Ip A DO RC ^. ANTES CER AD A AT (Analysis of 
Covariance ) DABEERBGBIECEETS Gelli Ime ^ ELS AI ^ A 
SERIE EH S (实验 组、 控制 组 > TESTAR R GE GAS 。 
表 7 EHE BRIT TERRE SE ^ BRUCE RGR» fe! 重点 剖析 1^ 
CS Gee + BARE , 与" eS ee , SFO E RS F EAT 308 2.471 > 
0.017 ` 0.000 E 0.787 ° T p THEI) 8 .102 ` .895 » .995 HA .378 > BRIERE 
TRA p [ECEICATS .05 > zz tex VUE H BAT ECERRH ER PE SURE SA] ， 
FE AS PTAA PTS a PSI EX PE Bde ^ DEG RT DEFT TAT 。 
He 8 Hl Ry FRAN UE E ^ EDU ET H ÉS F od lly 33.299 * 20.609 >` 
4.104 E 39.942 > Ti p (HEIA .000 > .000 > .046 82.000 > FAIA FRAT AW p fi 
上 皆 小 於 05 > XERIEVUSDELELHCEBEBRBUUAGERR e+ EC ER 。 
DES > BBR REE REIS 7 8173-3073 32.122 ` 20.000 ` 21.675 5175.878 ° 
if Fe A AA RES ZS} 30.120 > 20.429 > 20.926 HA 71.499 ;在 显著 水 
ME Dy OS ETUC T > IERTA H Te Bie R AAA A lA EK o 
由 於 在 和 整体 试题 ,的 平均 分 数 上 ， 实 验 租 显著 优 於 控制 租 ， 故 而 支持 了 本 研 
完 假 设 ， 也 就 是 应 用 深度 讨论 於 ePUB3 电子 书 翻 转 式 赔 读 理解 学 性 的 成 效 是 优 
於 应 用 一 般 讨 论 於 ePUB3 ES Me eS © 
2. 实验 和 组 学 生 潢 意 度 问 卷 调 查 
针 针 学 生 对 於 本 课程 视 意 度 调 查 ， 本 研究 论 实 验 和 组 上 商 和 结束 人 后， 根据 表 3 
以 问卷 调查 方式 进行 。 由 问卷 调查 结果 可 知 ， 学 生 回 应 此 8 个 题目 的 平均 分 数 
(EMER ) 43515 5.16( 73) ` 5.23(.77) ` 5.24(.74) ` 505(.91) ` 5.02(.92) ` 5.06 
(.89) > 5.15.81) * DS 5.13 (78) * 此 过 到 7 个 等 级 中 的 Ef 3 (52) SER CHR 
A7 实验 组 与 控制 组 学 习 成 效 后 测 之 
组 内 过 晤 傈 数 同 质 性 检定 摘要 表 
部 分 项 目 TypeIISS df MS F 信 p 
重点 剖析 6.618 6.618 2.471 .120 
SEO ERE 0.048 0.048 0.017 .895 


GEA 0.000 0.000 0.000 . .995 
整体 试题 。 8.563 8.563 0787 //1378 
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表 8 ”实验 组 与 控制 组 学 习 成 效 后 测 之 共 变 数 分 析 摘 要 表 


wom a Am BEG rE p ov 

重点 剖析 ”实验 租 49 32.122 33299" 000 275 
控制 组 ^ — 42 30.120 

BARE ”实验 租 49 22.000 20.609" .000 .190 
控制 组 —42 20.429 

明生 应 实验 组 ”49 — 21.675 4.104 046 045 
控制 组 42 20.926 

整体 试题 ”实验 组 49 75.878 | 39942" 000 312 
控制 组 42 71.499 

"p« 05, "p < 01. 

次 於 6 分 的 最 高 等 级 ) DLE * TAFEA DE FR a a ET ePUB3 ETE 


AiR» AREER ERRER - 


VEA, > BERI LEURS EL TIT) Core [oT Er] ^ ESAE re PEE TELS 


Ea tt SC PESE TR ^ BARA CAS» Mal Zeon EMSC ， 
以 下 列举 部 分 回应 : 


(1) 使 用 ePUB3 电子 书 翻转 式 学 各 

我 喜 获 上 课 前 能 够 先 预 读 ， 这 样 上 课时 就 有 概念 ， 也 可 以 有 充足 的 时 间 写 
笔记 和 查 资 料 。( 逐 字 稿 编 码 #02 ) 

我 党 得 电子 书 会 提升 阅读 乐趣 ， 有 影片 的 穿插 ， 比 纸 本 印象 深刻 。( 逐 字 
Tests 403 ) 

(2) 使 用 深度 讨论 

以 往 在 小 组 讨论 里 大 家 不 是 很 认真 ， 现 在 需要 记 儿 讨论 过 程 ， 大 家 也 比较 
专心 了 。( 逐 字 稿 篇 码 如 3 ) 

深度 讨论 鼓励 大 家 分 享 对 於 问 题 的 看 法 ， 因 为 之 前 有 先 练习 过 怎 廊 提 问 及 
回答 ， 可 以 让 我 们 自己 进行 讨论 ， 大 家 也 原意 参加 讨论 让 我 知道 同学 的 想 
法 ， 满 好 的 。( 逐 字 稿 篇 码 #404 ) 

(3) 整体 感想 

我 觉得 使 用 翻转 方式 跟 深度 讨论 上 课 十 分 新 鲜 ， 电 子 书 比 起 纸 本 书 更 有 
趣 ， 深 度 讨论 也 可 以 让 讨论 很 热天 ， 这 样 对 学 习 也 更 有 才 助 。( 水 字 稿 篇 
码 #03 ) 

我 喜欢 这 样 的 翻转 方式 上 课 ， 可 以 自己 看 电子 书 的 内 容 ， 也 可 以 让 我 跟 同 
学 一 起 讨论 可 能 的 答案 ， 整 个 上 课 的 气氛 很 不 一 样 ! 〈 逐 字 稿 篇 码 #404 ) 
最 和 后 ， 根 据 以 上 上 质 性 资料 ， 和 进一步 使 用 模板 式 分 析 法 (Template Analysis 


Style) 将 学 生 的 上 课 心 得 与 感想 记录 转换 成 抽象 概念 蔚 建 立 本 研究 的 代码 系统 


(Crabtree & Miller, 1999 )。 根 据 本 研究 目的 而 预 建 ! 翻转 式 阅 芒 理 解 学 虱 (A) | 
这 一 项 主旨 代码 以 及 'ePUB3 电子 书 翻 转 式 学 匀 (B) A'T DEEST SR (C) 过 两 项 
FCB RGR ^ IE TELL CZ OB > 0E ERROA RA RH! E 


SANDER. HEU PER PR 


EPJ (B1) 上 吸引 力 (B2) 
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有 用 性 (B3) 1 > 7 


j` 
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主 讨论 (C1)J、「 接受 度 (C2) ， 


等 五 个 分 类 项 目 ， 以 及 各 分 类 项 目下 贸 共 十 三 项 的 代码 。 最 合 ， 将 主 代码 与 子 


代码 合 余 ， 形 成 如 图 4 的 代码 系 第 


。 根 据 此 代码 系统 ， 受 访 学 生 在 ePUB3 电 子 


书 翻转 式 学 避 方 面 所 关注 的 芒 题 主要 为 自主 学 必 以 及 教材 吸引 力 与 有 用 性 ， 而 


在 深度 讨论 方面 ， 受 访 学 生 关 注 的 说 题 主要 裔 自主 讨论 以 及 接受 度 。 


翻转 式 阅 读 理 解 学 避 (A) 


ePUB3 电 子 书 翻转 式 学 必 (B) 深度 讨论 (C) 
HERG) 吸引 力 (B2) [有 性 (B3) 自主 计 论 (C1) 接受 度 (C2) 


预 读 (B1-1) 


提升 乐趣 (B2-1) 


有 概念 (B3-1) 


自己 计 论 (C1-1) 


好 方式 (C2-1) 


目 己 看 


书 (B1-2) 


新 鲜 (B2-2) 


提高 效率 (B3-2) 


知道 想法 (C1-2) 


Aral (C2-2) 


有 趣 (B2-3) 


印象 深刻 (B3-3) 


四 研究 千 采 及 讨论 


由 前 述 的 ' 散文 选读 


研究 所 提出 的 应 用 深度 讨论 於 ePUB3 ET E BEES SERE ER RT RR 
於 学 生 的 阅读 理解 学 炙 是 比 应 用 一 般 讨论 更 有 成 效 ， 而 学 生 亦 普遍 支持 使 用 
种 模式 进行 学 名， 因此 也 脸 议 了 本 研究 设 定 的 两 个 研究 辣 题 。 


图 4” 木 研 究 之 代码 系统 


' 放生 单元 


xul 


气氛 (C2-3) 


果 程 实务 教学 与 成 效 评 量 和 结果 可 知 ， 本 


EA 


BR 


iin 


TAI STRE AAS RB BOT ^ AFORE ERA 


论 而 对 於 应 用 深度 讨论 於 ePUB3 E FS GAL SE eS TET 
1 .应 用 深度 讨论 於 ecePUB3 电子 书 翻 转 式 阅读 理解 学 炙 时 


' 需要 以 学 生 为 主体 、 透 过 学 生 


规划 非常 重要 


2^, 
nm 


有 以 下 心得 : 
' 深度 讨论 的 活动 


自主 性 的 互动 及 分 享 持 灶 进 行 计 


局 了 诱发 与 持 转 讨论 ， 教 师 需 引导 计 论 的 进行 ， 六 要 求学 生 先 针对 教材 


内 容 进行 提问 徕 恰 ， 以 透 过 问题 提出 与 回应 的 循环 活动 ， 增 强 学 生 的 认 知 与 思 


是 高 学 生 合 秆 参与 议题 讨论 的 能 力 与 总 左 。 


之 后 於 芒 题 诗 论 时 “， 鼓励 


学 生 彼此 提问 、 分 享 ， 以 及 回应 ， 在 组 内 取得 结论 的 推 葵 及 斑 明 和 后， 引导 学 生 


进行 跨 和 组 分 扣 及 相互 评论 ， 使 学 生 能 多 得 更 多 元 化 的 理解 内 容 ， 


本 质 的 思考 与 判断 。 


2. 由 於 课程 进行 主要 以 学 生 


自行 阅读 教材 及 


参与 
随时 辅导 或 不 理学 生 过 到 的 况 题 ， 例 如 讲解 教材 时 学 
度 讨论 时 学 生 彼此 贱 产生 对 执 等 ， 因 此 随时 关 六 


= Be 33. AZA H 
.学生 学 加 


fee Fa sey eed 


FI 


ERE SE hae > 教师 需要 
EREET ENEO 深 
Abbo 发 现 问 题 了 解 


原因 “， 兹 和 给予 通 时 傣 助 或 辅导， 就 是 得 更 为 重要 。 然 而 ， 也 由 於 课程 以 学 生 自 
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fT aA Ke BEES ES RE ^ here SERA NAD ke Bee By 
的 意 顾 ， 如 此 也 减轻 教师 要 求学 生 阅 苇 教 材 以 及 参与 活动 的 原 力 。 

3. 透 过 问卷 调查 ， 教师 除 可 了 解 学 生 对 於 课程 进行 的 袜 意 度 ， 更 重要 的 是 
能 狗 了 解 自己 教学 上 的 可 能 缺失 ， 例 如 题目 Q4-Q6 有关 使 用 深度 讨论 进行 学 虱 
的 评 量 分 数 较 低 且 标准 差 也 较 大 ， 如 此 亦 反 映 出 部 分 学 生 对 於 使 用 深度 讨论 进 
行 学 虱 感 到 有 可 以 改进 的 地 方 。 轻 过 了 解 后 得 知 ， 主要 是 因为 部 分 学 生 觉 得 ， 
深度 讨论 的 进行 应 南 要 更 完整 ， 例 如 分 享 及 互 评 和 后 就 进行 课 和 后 测验 ， IRATE 
会 再 去 诗 论 修改 原本 的 答案 ， ROPE ATS ° SEALER ^ ASESORES IBS 
来 工作 加 以 详 和 组 探讨。 


Ti^ fiii FE a 


(一 ) 研 究 成 果 及 页 页 

本 研究 闭 重 於 如 何 应 用 以 深度 讨论 希 核 心 的 ePUB3 E Pe ERG 
於 天 读 理 解 学 名 ， 茹 针对 运用 此 模式 的 课程 进行 设计 ， 使 课程 能 运用 深度 讨论 
法 ， 增 加 学 生 分 析 与 综 整 的 能 力 ， 以 提升 天 读 理 解 学 愉 的 整体 成 效 。 接 著 ， 本 
研究 运用 所 提出 的 课程 设计 於 某 大 学 阅读 教学 RTE! BOCER | | Æ j EJE 
的 实务 教学 与 成 效 评 量 ， 而 和 经 由 准 实 验 研 究 法 实验 组 与 控制 组 对 照 分 析 以 及 学 
生 渍 意 度 调 查 的 结果 可 知 ， 本 研究 所 设计 的 以 深度 诗 花 角 核 心 的 ePUB3 电 包子 书 
翻转 式 阅 广 理解 学 必 课 程 ， 革 於 学 生 重 点 剖析 、 整 合 夫 释 、 明 秽 应 用 等 能 力 的 
培养 是 比 应 用 一 般 讨 花 更 有 成 效 ， 而 学 生 亦 普 珊 支持 使 用 以 深度 计 诊 为 核心 的 
ePUB3 电子 书 翻 转 式 学 虱 模 式 进 行 学 虱 ， 符 别 对 於 应 用 深度 言论 进行 小 和 组诗 花 
SETH Ei e WEY) > 由於 课 程 主 要 以 学 生 自行 阅 芒 教材 及 参与 学 必 活 动 久 核 
心 "教师 改 以 辅导 或 处 理学 生 问题 鸭 主 ， 而 如 此 使 用 ePUB3 电子 书 教材 ， ME 
使 得 学 生 可 依 自己 喜好 弹性 阅读 ， 更 提高 了 学 生 参 与 学 镁 活动 的 意 顾 ， 如 此 也 
减轻 不 少 教师 协助 或 辅导 学 生 参 与 学 属 活 动 的 愿 力 。 

因此 ， 本 研究 所 提出 以 深度 计 论 为 核 心 的 ePUB3 电子 书 翻 转 式 阅 芒 理解 学 


虱 强 程 慨 计 、ePUB3 电 子 书 教材 ， 以 及 应 用 深度 计 论 於 epUB3 电 子 书 翻转 式 学 
锻 课 程 实务 教学 等 内 涵 ， 可 提供 天 诸 理 解 教学 领域 的 先进 及 同好 参考 ， 闻 期 许 


本 研究 的 成 果 能 对 阅 芒 理解 的 教 与 学 产生 更 多 正面 成 效 与 影响 力 。 


号 研究 限制 及 未 来 研究 建议 

本 研究 对 於 深度 兰花 的 实施 流程 以 及 学 生 学 必 成 效 及 满意 度 的 验 诈 ， 仍 有 
可 加 强 忆 处。 因此 “未 来 可 持 逢 应 用 於 其 他 学 校 或 单位 的 圈 许 理解 学 名 课 程 ， 
LASTE AERA R e ESk ^ BISHEEREER IRAE AP BLOCS ERE ER TE EE IS 
同 的 多 个 单元 ， 例 如 现代 文学 、 古 典 文 学 、 实 务 应 用 等 ， 由於 各 哩 元 的 性 质 不 


蔡 妨 婷 、 许 庆 异 、 林 至 中 : REESE) DUSePUB3 E FES Cheat AES 361 


EM 


le] > AO EAGLES ATR Ia) > AEAN RE Ae aa TSA Led 


Bic ^ ERI 行动 研究 1 TK GRES > 2013 ; SHA > 2000 > 2015) 的 循环 式 
提问 与 带领 以 及 质 性 与 量化 分 析 “， 以 深化 学 生 学 虱 成 效 及 满意 度 的 评 量 ， 将 可 
成 为 未 来 的 研究 重点 。 


PEs > SEIHePUBS ET EMRA ER Uy > BR DR a ia BOL 
外 “， 亦 可 搭配 使 用 不 同 的 教学 方法 ， 例 如 探 完 式 学 必 (inquiry-based learning ) 
或 情境 式 学 习 (situated learning) 等 ， 例 如 以 探 完 式 学 虱 或 情境 式 学 虱 包 核心 的 
ePUB3 志 子 书 翻 转 式 学 必 模 式 ， 而 如 何 规划 过 些 模式 的 学 避 活 动 ， 以 及 设计 与 
测 作 配合 这 些 学 怖 活动 进行 的 ezPUB3 电 子 书 教材 ， 使 芝 些 教学 万 法 能 透 过 通 当 
的 ePUB3 电子 书 教 材 以 及 翻转 式 学 钴 活动 加 以 完成 ， 就 是 得 相当 重要 ， 未 来 本 
研究 也 将 朝 此 方向 做 深入 的 探讨 。 
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Abstract 


In recent years, “reading comprehension” has become one of the core general 
education courses in colleges. Meanwhile, flipped learning is a common 
way used in domestic education sectors for the teaching of these “reading 
comprehension” courses. This paper explores how to employ quality talks in 
the ePUB3 eBook-based flipped learning and hence proposes a quality talk- 
centric ePUB3 eBook-based flipped learning “reading comprehension” course 
design for increasing the learning effects of students’ “reading comprehension”. 
Then, it applies this design to the “prose reading” unit of a “reading teaching” 
course in a local university to design its ePUB3 eBook contents and quality talk 
mechanisms. For assessment, a quasi-experimental study on the control analysis 
and its accompanied questionnaires are conduced to verify students’ learning 
effectiveness and satisfaction of applying quality talks to the ePUB3 eBook- 
based flipped learning in “reading comprehension” courses. The research 
results show that the proposed course design, through the quality talk-centric 
ePUB3 eBook-based flipped learning, can produce the better learning effects of 
students’ “reading comprehension” than that through the general talk-centric 
one. Further, students also satisfy using this approach in their learning. 


Keywords: Quality talk, Teaching practice, Course design, Reading 
comprehension, Flipped learning, ePUB3 eBook 


SUMMARY 

In recent years, “reading comprehension” has become one of the core 
general education courses in the domestic education sector. Meanwhile, 
flipped learning is a common way used in schools for teaching the “reading 
comprehension” courses. It encourages students to preview the learning contents 
before classes, and then to discuss designated topics in classes to complete the 
learning of reading comprehension. However, although there are already many 
teaching experiences in such flipped classes for “reading comprehension" in the 
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domestic schools, most of these classes use videos as their teaching media; the 
delivery of learning contents is less flexible to accommodate students’ diversified 
learning needs. Since flipped learning encourages students to preview learning 
contents before classes and to participate in topic discussions during classes, how 
to deliver learning contents through suitable ways for enhancing the effects of 
students’ reading contents and encouraging student participation in discussions 
has become a critical issue in the teaching of the flipped “reading comprehension” 
courses. 

To address this issue, some enhanced delivery ways of learning contents 
using ePUB3 techniques had been presented in earlier research works. 
Afterwards, they were applied to some flipped classes for “Applied Chinese” 
courses. In these classes, students previewed learning contents in ePUB3 eBooks 
before the classes. Then student-centric discussions were conducted during the 
classes. Based on these experiences, although the effects of students’ reading 
contents in ePUB3 eBooks could be concluded, some shortcomings of using 
ePUB3 eBooks in the flipped “reading comprehension” courses were found. 
This is because the “reading comprehension” courses are mainly for enhancing 
students’ abilities of analyzing, interpreting, and applying the content. It is thus 
necessary to develop these abilities through effective topic discussions in the 
classes. However, existing teaching experiences reflect a major problem. That is, 
the current topic discussions are conducted in a way of general group discussions. 
Due to the lack of effective guidance or structured methods, there are often no 
organized communications or logical inferences in the discussions. This makes 
students unable to figure out effective conclusions, thus reducing the effects of 
these discussions. Students therefore cannot gain an effective development for 
their “reading comprehension” abilities. 

Therefore, this paper expends the existing ePUB3 eBook-based flipped 
learning by exploring how to enhance the effects of students’ topic discussions. 
For this, the emerging quality talk (QT) method is used during the discussions 
to provide the students with a more robust discussion environment for learning 
“reading comprehension”. Since an enhanced environment can increase 
students’ willingness to participate in the discussions through the QT-emphasized 
interactive questions/responses and collaborative problem solving, the students’ 
cohesiveness during the discussions can be strengthened for drawing effective 
conclusions and hence their “reading comprehension” abilities can be better 
developed. 

Further, for realizing the application of QT in ePUB3 eBook-based flipped 
learning and verifying its effectiveness, a lesson design process is explored 
that specifies the lesson plan for using ePUB3 eBooks in.students? reading 
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and deploying QT in their topic discussions. In general, this process takes 
considerations of the flipped learning of the “reading comprehension” courses, 
the curricular contents of ePUB3 eBooks, the QT method for topic discussions. 
Hence, it has the following four steps: 


1.Ensure the learning objectives/teaching strategies of a “reading 
comprehension" course 
In general, the first step of designing a course is to confirm its learning 


objectives and teaching strategies. This is because the learning contents and 
activities of a course should be designed for achieving its objectives and 
strategies. Therefore, this step focuses on the identification of the course learning 
objectives and teaching strategies as follows. 

* As mentioned earlier, a “reading comprehension” course is designed 
to enhance students’ abilities of analyzing, interpreting, and applying 
the course content. Its learning objectives can thus be identified as: (1) 
analyzing the course content for identifying focuses, (2) interpreting the 
course content for recognizing the meanings, and (3) applying the course 
content for innovative uses. 

。 Based on the learning objectives, it is time to formulate the teaching 
strategies applied to achieve these objectives. Specifically, teaching 
strategies can be tailored based on the following considerations: (1) teaching 
methods (e.g., direct teaching, online learning and inquired discussion), (2) 
teaching ways (e.g., class, group and individual), and (3) teaching activities 
(e.g., reading contents, explaining contents, producing products and solving 
problems). Therefore, for a “reading comprehension” course, its teaching 
strategies can be formulated as: (1) individual online learning before the 
course class (reading contents), (2) class direct teaching of learning contents 
in the class (explaining contents), and (3) group topic discussions in the 
class (solving problems), to achieve the objectives of developing students’ 
abilities of reading comprehension. 


2.Specify the learning activities of the course 
In general, this can be completed by the following works (steps) 


Identify the learning activities based on the formulated teaching strategies. 
Since the course is student-centric (student-centered) under the ePUB3 
eBook-based flipped learning mode, teachers can identify the learning 
activities according to the teaching strategies and any necessary evaluation: 
(1) before a class, students preview the curricular contents of the ePUB3 
eBooks used in the class, (2) at the beginning of the class, students take 
a pre-class test for evaluating the effect of the preview, (3) in the class, 
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teachers give a lecture based on the results of the pre-class tests to enhance 
students’ essential knowledge for improving their participations in group 
discussions, (4) in the class, students conduct the group topic discussions 
and develop their abilities of reading comprehension, and (5) at the end 
of the class, students take a post-class test for evaluating what they have 
learned from the class. 

* Design the specifics for the aforementioned group discussions (4) based on 
the QT method. As mentioned earlier, QT emphasizes the use of interactive 
questions/responses and collaborative problem solving to increase students’ 
willingness to participate in discussions and then to strengthen their abilities 
of gathering consensus to figure out effective conclusions. Therefore, 
teachers can design the following group discussion specifically based on 
both of the QT method and feedback and evaluations: (1) teachers explain 
the QT process before the discussions, and ask students to practice the 
interactive questions/responses —asking questions (e.g., inquiring texts, 
sharing experiences, and exploring knowledge) and responding to the 
questions (e.g., supportive/extensive/critical responses), (2) students 
conduct the discussions using the interactive questions/responses method 
for solving the topics designated by teachers, (3) students complete the 
inferences, verifications, and presentations of the conclusions. Since 
students already have experiences in cognition and thinking, and have also 
practiced the QT-emphasized collaborative problem solving by sharing 
ideas, inquiring hypotheses, and providing evidences, their cohesiveness 
in the discussions can be strengthened to gather consensus for figuring out 
effective conclusions, (4) students share and comment their conclusions and 
teachers give adequate comments and suggestions for assisting their self- 
assessments and reflections. 

* Specify the learning activities based on the above activity identifications 
and discussion designs where learning contents, times, and resources (e.g., 
teaching assistants) are specifically considered. As such, the learning 
activities for a “reading comprehension” course can be specified as follows: 
(1) before a class (7 days), students preview the ePUB3 eBooks, (2) at 
the beginning of the class, students take a pre-class test (5 minutes) for 
evaluating the effects of their preview, (3) in the class, teachers give a 
lecture (10 minutes) to enhance students’ essential knowledge, (4) in the 
class, students conduct the group topic discussions (50 minutes) to develop 
their abilities of reading comprehension, (5) in the class, students share 
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and comment their conclusions and teachers give adequate comments and 
suggestions (30 minutes), and (6) at the end of the class, students take a 
post-class test (15 minutes) for evaluating what they have learned from the 
class. 


3.Design and construct the contents of the ePUB3 eBooks used in the 
course 
This step focuses on the content design and construction of the ePUB3 


eBooks used in the course. In general, this work can be achieved by considering 
what the curricular contents are and how students can take advantage of ePUB3 
eBooks and embedded functions (e.g., various templets, multiple media, 
interactive communications, and dynamic displays) to increase the effects of 
students’ reading contents and participating in their QT-centric discussions. 
After designing the contents and embedded functions of the ePUB3 eBooks, 
the construction can be easily achieved by using many applicable tools such as 
ViewPorter, InDesign, and Calibre. Considering the features and the quality of 
constructed artifacts, ViewPorter is used herein to construct these ePUB3 eBooks 
for the course. 


4. Instruct and assess the classes of the course 
After constructing the ePUB3 eBooks, the course can be instructed according 


to the class schedule. In this step, each class is instructed based on the learning 
activities specified above. For assessment, two ways are conducted as follows. 
(1)A quasi-experimental study on the control analysis of experimental and 
control groups is conduced to verify students' learning effectiveness of 
applying QT to the ePUB3 eBook-based flipped learning in the class. 
(2) Accompanied questionnaires are conduced to verify students’ preferences 
of applying QT to the ePUB3 eBook-based flipped learning in the class. 
For illustration, the process above was applied to the ‘prose reading’ unit 
of a ‘reading teaching’ course in a local university. For assessment, a quasi- 
experimental study on the control analysis of experimental and control groups 
and the accompanied questionnaires were conducted where (1) these two groups 
had 49 and 42 students respectively, (2) they had similar enrollment ages, scores, 
and backgrounds, and (3) they had no learning experiences on flipped learning, 
ePUB3 eBook, and QT. After the research, its results show that the proposed 
course design, through the QT-centric ePUB3 eBook-based flipped learning, can 


9 66 


produce the better learning effects of students’ “reading comprehension” than that 
through the general group discussions. Further, students also satisfy applying QT 


to their ePUB3 eBook- based flipped learning. 
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Abstract 


This study explored international students’ experiences in online tutoring of 
remote learners from four elementary and junior high schools in Taiwan. A 
second objective of the study was to investigate whether online tutoring cultural 
exchange between the international students and the remote learners could 
promote cultural awareness. 39 international students from a Taiwanese 
university were paired with 39 Taiwanese remote school learners. The 
international students reflected on their tutoring experiences and cultural 
awareness using both videos and essays after participating in the online 
tutoring program for a period of ten weeks. The results indicated that by 
participating in the program, the international students gained some skills in 
teaching, learned a new language, received encouragement from their peers, 
and helped the tutees to gain confidence to communicate using English more. 
The international students also appreciated the opportunity that the project 
gave them to exchange their culture with the students of Taiwan. Although 
some of them faced a language barrier challenge, they were able to learn about 
some aspects of the culture of Taiwan from the tutees. Thus, being a more cost 
effective option for learning a culture than for instance visiting a country to 
learn a culture, learning institutions could provide opportunities and encourage 
students to participate in such cultural exchange programs. 
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Introduction 
The use of digital technologies to support live teaching and learning can 
extend the reach of traditional teaching and learning space to provide the learners 
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with ubiquitous learning opportunities and massive benefits (Higgins, 2004). Such 
a learning platform is online tutoring, which offers opportunities and possibilities 
to reach remote individuals with diverse socio-economic status (Bruning, 2011) 
through the use of interactive communication technology provided for by the 
Internet and Web 2.0. This way, students with learning difficulties in rural areas 
can always be identified and supported. Corrigan (2012) defines online tutoring 
as provision of a personalized learning support to a single or small group of 
learners by the teacher, also called a tutor, through the Internet. 

While traditional tutoring relies on a one-on-one meeting and has been 
used to provide remediation to students on subjects that they are weak in, online 
tutoring has leveraged the advancements in technology and network connectivity 
such as Web 2.0 that supports synchronized and real time communication to create 
virtual classes where the tutors and tutees can meet and learn (Peacock et al., 
2012). In addition, the ability of online tutoring to combine effective elements of 
conventional tutoring programs, such as well-trained and competent tutors, project 
and problem based learning curricular coupled with active learning resources etc. 
gives the online tutoring a cutting-edge advantage. For instance, online tutoring 
is able to provide synchronous one-to-one and real time services to reach learners 
in both busy urban areas and rural remote schools (Chappell, Arnold, Nunnery, & 
Grant, 2015). 

Through the use of telecommunication technologies, online tutoring 
provides authentic experiences to tutors which can help them to increase their 
capabilities such as provision of individualized instruction, improving language 
and communication skills, and cultural exchange (Cifuentes & Shih, 2001). In 
addition, from the experience of tutoring, college students are provided with an 
opportunity to obtain practical knowledge on issues such as time management, 
preparation of tasks, problem solving, and teaching activities (ChanLin, 2016). 

With advancement in technology, people are now able to learn and interact 
with different cultures and languages without necessarily attending a formal 
traditional class learning setup by leveraging digital opportunities such as tele- 
collaboration that enables for instance, language learners to converse with 
the native speakers of the language remotely—i.e., without the need to meet 
them physically (Çiftçi & Savas, 2018). This is because people can now take 
advantage of advancement in technology and easy access to the Internet from the 
computing personal devices to interact with people across cultures that has led 
to intercultural interactions and exchanges based on tele-collaboration (Shadiev, 
Wu, Sun, & Huang, 2018). This has broken the boundaries and increased global 
interconnectedness and intercultural interactions. For instance, through virtual 
exchange programs, students can explore cultural practices, to prepare. them to 
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live in a culturally diverse society, whether at home or when interacting with the 
culture abroad (Schenker, 2013). 

Cultural awareness is one of the key competencies for individuals to 
interact in the 21st century due to globalization (Schenker, 2013). This is 
because globalization has led to global challenges which can only be solved by 
building new links between countries and cultures (Talalakina, 2010). Notably, 
an increased awareness helps individuals appreciate a target culture. This helps 
them challenge stereotypes they could be having about that culture (Hertel, 2003). 
Individuals may learn culture through various ways including direct and indirect 
contact with people from other countries, visiting other countries, watching 
foreign movies, and use of computer mediated communication (CMC)—text 
based tools such as online discussion boards and video conferencing (Angelova & 
Zhao, 2015; Cardon, 2010). 

Online tutoring supports the learning of students in rural areas since these 
students have limited learning resources and support (ChanLin, 2016). The need 
for this project arose due to two reasons. First, due to geographical limitations, 
rural school children in Taiwan have few or no opportunities to interact with 
foreigners to engage in discussions and exchange cultural viewpoints. Second, 
international students in Taiwan come from various countries of the world and 
for most of them this could be their first time in a foreign country. Thus, for most 
of them adjusting to the culture of Taiwan could be a challenge due to cultural 
shock they may experience, and stress as they try to adjust to a new culture and 
learn a new language (Yang, Webster, & Prosser, 2011). Moreover, being miles 
away from home, they may lose friendships and networks they had established 
hence the need to form new social support networks. Therefore, it is necessary to 
provide them with effective means that can help them to interact with the locals 
to be able to gain some useful information that could assist them live in a society 
which is culturally different from what they are used to. With the aid of modern 
information and communication technologies, online exchange is considered as an 
effective means for the local and international students to interact and exchange 
their cultures. This interaction also provides an opportunity for the children to 
practice their English speaking skills in an authentic learning environment. 

This opportunity to exchange cultural viewpoints is beneficial to both the 
Taiwanese and the international students beyond the educational setting since 
the world is increasingly becoming multicultural as a result of globalization. 
Therefore, the students need to be provided with opportunities that can prepare 
them to live and work in a multicultural society, for instance, in the professional 
world (Czerwionka, Artamonova, & Barbosa, 2015). Moreover, an increased 
cultural awareness makes individuals more tolerant to people from cultures 
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different from theirs (Tomlinson & Musuhara, 2004). This is because with 
increased cultural awareness people from different cultures are able to understand 
their cultural differences resulting to peaceful relationships (Shadiev et al., 2018). 

Through this online tutoring project, referred to as “Digital Learning 
Companion” and hereafter referred to as “DLC” project, the rural students are 
partnered with international digital companions (international students) from 
various countries in the world thereby providing the students with greater 
educational opportunities and overcoming geographical limitations (Cheng, Liu, 
Ko, & Lin, 2007). The purpose of the project was majorly for cultural exchange 
and not for English language learning although it provided an opportunity for 
the tutees to practice their English speaking skills. The international students 
provided one-to-one tutoring to online tutees from remote areas of Taiwan through 
an online tutoring platform. Through assigned topics, the tutors and tutees 
exchanged cultural knowledge. We partnered the international students with 
the rural students so as to provide the rural students with opportunities that they 
may not be able to have like their counterparts in the city. Compared to college 
students or elementary school students in the city, rural school children are more 
disadvantaged. For instance, rural students not just in Taiwan, but worldwide face 
challenges such as insufficient and ill-developed infrastructure like inconvenient 
transport, inadequate learning resources such as few qualified teachers and 
facilities, and economic challenges such as limited financial support. Therefore, 
we hope that this project can have a social impact on the rural community as 
the international students could provide support to the rural students. For the 
Taiwanese students, this project provides them with an opportunity to interact with 
foreigners and to engage in discussions and to exchange culture since they have 
limited educational resources due to time, space, and geographical limitations 
(Cheng et al., 2007). Although the rural students speak mostly Chinese, they 
could speak basic English since they start to learn English from the first grade 
according to the curriculum enforced by the Ministry of Education in Taiwan 
(Lin & Ivinson, 2012). However, they needed to be encouraged to use English 
since they were shy to speak in English because rural school children in Taiwan 
do not consider English as a relevant and an important subject, and they also lack 
opportunities to practice speaking English (Lin & Ivinson, 2012). 

Similar online tutoring programs have been conducted but their focus has 
been on offering tuition to rural students in Taiwan to improve performance in 
areas such as Mathematics, English, and Chinese (ChanLin, 2016; ChanLin, 
Lin, & Lu, 2016; Huang & Liu, 2015). These studies also used Taiwanese 
college students as tutors. As such, there is need to investigate the possibility of 
leveraging online tutoring for cultural exchange and general/exposure. to.other 
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ways of life. This was the focus of this study. Thus, this research investigates 
the online teaching and learning experiences of international students at a 
university in Taiwan to identify some cultural learning aspects, benefits, and 
challenges linked with the cultural exchange project. Since it was the first time 
for the international students to participate in the project, through studying their 
experiences, we could be able to understand how they interacted with the local 
students. This knowledge could be useful for evaluating the project and for 
improving future similar projects that would be conducted. 

The specific objective is to provide evidence for whether participating in 
online tutoring by international students in Taiwan with students from Taiwan 
increases their cultural awareness about Taiwan in aspects such as food, clothing, 
among others. This article attempts to answer the following research questions 
based on preliminary findings obtained from the data collected during the study: 

1.What are the experiences—benefits, likes, dislikes, and challenges— of 

international students in the DLC project? 

2.Does the DLC project facilitate cultural awareness? 


Research Method 


Study Context 

The DLC project was implemented for a semester. International students at 
a university in Northern Taiwan were paired with junior high school or elementary 
school students from different rural areas in Taiwan. Four schools participated 
in the project. The international students were recruited at the beginning of the 
spring semester of 2018 based on how passionate they were about teaching the 
tutees and their skills and motivations for taking part in the project. 

The recruited tutors were oriented on how to use the JoinNet system— 
the online learning platform that was used in this study—by the project support 
team. They were also trained on how to prepare the teaching materials like the 
lesson plan and the teaching slides by experienced members of the project support 
team who were experienced student teachers. They were guided on some of the 
activities they needed to include in their teaching materials. This was to ensure 
that the materials prepared by the tutors were standard across all the tutors. 
The tutors were also given some background information about the project, for 
instance, some information about the rural students. The project lasted ten weeks. 
The tutors and tutees were expected to exchange cultural information, apart from 
a general discussion, about their countries based on the following topics: food, 
clothing, transportation, housing, entertainment, and famous scenery. In general, 
based on each topic, tutors gave brief introduction of their countries of origin then 
asked the tutees to talk about their countries. Figure, 1.shows,some, screenshots 
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of the contents of the teaching materials prepared by the tutors. Each topic was 
discussed once a week except for food, entertainment, and famous scenery which 
were discussed for two weeks. Each tutor prepared his/her own teaching material 
and content based on the given topics every week. They were also at liberty to 
use teaching strategies that they found to be effective for them and their tutees. 
To ensure that the teaching materials prepared by the tutors were effective, the 
tutors were required to upload all their teaching materials to the project website 
prior to conducting their sessions. These were reviewed by the support team to 
help moderate the materials prepared by the tutors. To assess the progress of 
the tutoring sessions and address any problems arising, all the teaching sessions 
were also videotaped and reviewed on a regular basis by the project support 
team members. Figure 2 displays a screenshot of the JoinNet platform during a 
tutoring session. On the whiteboard, both tutors and tutees could be able to write 
and make notes or browse the Internet, and they could be able to interact freely. 


Do you know how to cook? 


1.How do you cook your favorite food? 


My your favorite food is?.............. Step 1... 
Step 2... 
Step 3... 
Step 4... 


Figure1 Sample Teaching Materials 


Each tutor and tutee was provided with a PC with internet connection, 
headset with a microphone, and a webcam. All the tutors conducted their tutoring 
sessions from a central point, the university's computer centre. There were four 
tutoring sessions every week for ten weeks. Each session lasted one and a half 
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hours. However, each tutor was assigned only one session per week. One session 
was conducted on Mondays from 1:30 p.m. to 3:00 p.m. Other sessions were 
conducted from 6:30 p.m. to 8:00 p.m. on Tuesdays, Wednesdays, and Fridays. In 
other words, tutors conducted a tutoring session once every week, that is, either 
Monday or Tuesday or Wednesday, or Thursday according to the day they were 
assigned. Each tutee was assigned to only one tutor for the duration of the 
program. Therefore, a tutee attended only one tutoring session per week lasting 
one and a half hours, for the ten weeks, on the same day of the week, with the 
same tutor. After each tutoring session, the tutors were required to write their 
reflection about the session in an online diary system. They also shared their 
experiences among themselves after the tutoring sessions starting from the fifth 
week of the project. Every week from the fifth week, three to four tutors shared 
their tutoring experiences with other tutors. 

During the last two weeks of the project, the tutors were required to complete 
a reflection task. They were required to reflect on their tutoring experience and 
also reflect on what they learned about Taiwan culture through their tutees using 
self-created videos. The tutors were also required to reflect on their tutoring 
experience using a 150-word essay. The purpose of the reflections was to know 
about the tutors’ experiences during the project and to know about how much they 
had learnt about the culture of Taiwan, and their perceptions on the benefits and 
challenges gained, from the interaction with the students from Taiwan. 
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Figure 2 Screenshot of the JoinNet Platform During a Tutoring Session 
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Participants 

The participants in this study were 39 international students from various 
departments at a university in Taiwan. They were paired with 39 students from 
some rural schools in Taiwan. Among these tutors, 18 were male, and 21 were 
female. The tutors were from various countries. They ranged in age from 
21 to 40 years (Table 1). Since the participants are international students, the 
communication with the tutees was done in English. 


Table 1 Demographic Information 


Item Category No. % | Item Category No. % 
Gender Male 18 462|Major Applied science 1 26 
Female 2] 538 Engineering (various) I9 353 
Education level Master 35 ES Applied foreign languages 6 154 
Ph.D. 4 10.3 Industrial management » T 
Nationality Indonesia 24 615 Digital learning and education 5 12.8 
Vietnam 11 282 Finance 2 Sil 
Burkina Faso 1 2.6 Material science l| 26 
Thailand 1 26 Architecture Basel 
India 1 26 Information management 3) To 
The Gambia 1 26 Business administration Sk Tel 


Data Collection and Analysis 

Although this study involved both tutors and tutees, the focus of this study 
was on the tutors only. Therefore, the analysis of tutees data is beyond the scope 
of this paper. However, we are in the process of formulating the second phase 
of this study that intends to illustrate the impact of such a project to the tutees. 
The data was collected using qualitative methods. The reflective videos, written 
reflections, sharing experiences forum discussions, and online journal entries 
served as sources of the qualitative data. The reflection questions for online 
experiences and cultural awareness were adapted from previous studies (ChanLin, 
2016; Hertel, 2003; Hung, 2011; Schenker 2013) 

Of the 39 tutors who participated in the project, complete data was available 
for only 27 tutors. Some tutors participated in all the tutoring sessions but they 
did not complete all the reflection tasks. To achieve data triangulation, the 
different qualitative data types (reflective videos, written reflections, sharing 
experiences forum discussions, and online journal entries) were analyzed:using 
content analysis (Angelova & Zhao, 2015). The data from the video reflections 
were transcribed verbatim first before coding. Two independent researchers 
reviewed all the written data and generated codes to identify patterns in the tutors' 
reflections that represented their tutoring experiences and cultural. learning which 
were the focus of this research. Coding consistency was analyzed between the 
researchers. The inter-rater reliability, 0.91, was evaluated by using Cohen's 


Otanga, Weng, Weng, & Chu: Tutor Experiences and Cultural Awareness in the DLC Project 381 


kappa. Few differences that were obtained between the researchers after coding 
were discussed and resolved. 


Results 

The qualitative data analysis of the contents of the online tutors’ video 
reflections, written reflections, online journal entries and sharing experiences 
forums yielded the following themes characterizing the experiences of the 
international students during the online tutoring project: general tutoring 
experiences and cultural awareness. The general tutoring experiences are 
discussed under the following sub-themes; benefits and achievements of online 
tutoring —i.e., acquisition and improvement of teaching skills, language learning, 
cultural exchange, peer encouragement, helping tutees boost their confidence to 
speak English, and developing friendships and relationships—likes and dislikes of 
the program, challenges of online tutoring, and overall experience. 


General Tutoring Experiences 
Benefits of and achievements from online tutoring 

From the reflections of the tutors, it was found that the online tutoring 
benefited them in a number of ways. These benefits and achievements are 
discussed under the following categories: acquisition and improvement of teaching 
skills (both online and teaching in general), opportunity for language learning, 
peer encouragement, opportunity for cultural exchange, helping tutees boost their 
confidence to speak English, and developing friendships and relationships. 

Acquisition and improvement of teaching skills 

For most of the tutors, this was their first time to teach students. Some tutors 
had ever taught face to face before taking part in this project, but they had no 
experience about online tutoring. Among the ways in which the online tutoring 
helped the tutors acquire and enhance their teaching skills based on the tutors’ 
reflections include learning to: adjust teaching strategies according to individual 
learners needs, use technology to teach, prepare teaching materials, manage 
students, do online tutoring and work with children. 

Through this online tutoring, the tutors learned how to be flexible and adjust 
their teaching strategies according to the needs of their students for instance 
try to use both English and Chinese after realizing their tutees were not able to 
communicate fluently in English. For example, a tutor stated that: 

So overall I think I understand something new here. I get many experience. 

The first one I cannot fix in one thing because when the situation change like 


my student cannot speak English, I have to change the strategy, I have to try 
use Chinese to approach him. (T25, video reflection) 
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Other strategies like use of games and inclusion of pictures were also used by the 
tutors to enhance the tutees’ understanding. For instance, one tutor stated: 

My student is not good at English as well as my Chinese. I had tried a 

lot I found that speaking less and adding attractive games and pictures is 

good methods for my student. I also employed google translate to help in 

explaining the meaning of new words to my student, that was good too. 

(T10, sharing forum) 

Other tutors changed the teaching and learning activities and used both languages 
to prepare the PowerPoint slides. For instance, a tutor stated: 

I am shocked that my student cannot say anything in English except “yes”, 

"no", and “I don't understand". I change my PPT to be bilingual, English 

and Mandarin version so I provide two sentence form, first line is English 

and second line is Mandarin, and changing the activities to be reading 

more. (T15, video reflection) 

The online tutoring helped the tutors to improve on how to prepare teaching 
materials and deliver the teaching content. For instance, a tutor indicated that 
"Having this opportunity has helped me improve how I prepare in various aspects 
such as material preparation, teaching delivery, immediate problem solving 
skills, and ways to manage with the student" (T02, written reflection). One tutor 
mentioned that "I can learn how to make best PPT (such as topic, forms, etc.) 
based on my student characteristics and encountered-problems" (T15, written 
reflection). Another tutor, further indicated that “ ... I get an experience to teach 
to the other student from another city from Taitung. I also get the experience to 
teach English especially for elementary since this is also my first time to teach 
English for the elementary" (T32, video reflection). Apart from general teaching 
experience, the tutors also acquired some skills for online teaching. For instance, 
a tutor stated that “After that I feel like I have learned a lot from the program like 
online tutoring experience..." (T29, video reflection). Tutor T11 mentioned that 
“T really like this program a lot because it's not only the students who can gain 
experience and benefits but I also gain benefits as well. That I can learn how to 
do distance learning..." (T11, video reflection). 

Apart from gaining a teaching experience, the tutors also learned ways of 
managing their students for instance, through preparing the teaching content in 
ways such that the attention of the tutee could be maintained for a longer time. 
Some tutors' reactions include: 

My student I would say is very easily distracted. Even if I leave her for 

20 seconds without something, without a video, without a puzzle, she will 

look around here, here, find something or go to her friend. She will do 

all types of things. So I need to put a video like in each slide because I 
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have noticed that sometimes she is not interested if I do not because I have 

notice that my student is very new to English. (T06, sharing forum) 

A tutor mentioned about learning to manage the students’ emotion “Eventually, 
I got valuable experiences from this project, not only pedagogic strategies, but 
also how to maintain and deal with student's emotion when she had been so tired 
of her classes at school before joining my online class each week" (T08, written 
reflection). 

Some tutors appreciated the opportunity which helped them to learn how to 
work with children. For instance, a tutor mentioned that “I felt that I could learn 
many things. I knew how to work with children more. I think participating in 
DLC not a bad choice. I think DLC is very interactive. Every week is a new fun 
for us" (T18, video reflection). Another tutor further indicated that “After that 
I feel like I have learned a lot from the program like online tutoring experience, 
how to work well with children who cannot speak my native language" (T29, 
video reflection). 

In terms of using technology to teach, a tutor mentioned that “It is great to 
utilize technology so I got the valuable experience and I know how to do in the 
future if I have same chance, same related-problems, etc." (T15, video reflection). 

The tutors’ comments indicate that they learned not only how to teach, 
but also how to teach online and using technology which most of them had no 
experience in. The tutors also learned how to provide individualized instruction 
based on learners’ needs. Therefore, the project was useful for acquiring skills 
and experience necessary for their professional development. The tutors’ 
creativity also improved through preparation of the teaching materials like 
PowerPoint slides. 

Language learning 

In their reflections most tutors indicated that most of the tutees were not able 
to speak good English. As a result, language barrier affected their communication. 
To be able to communicate effectively, most of the tutors opted to use both 
Chinese and English to communicate with the tutees but this was a challenge to 
the tutors as they could not speak Chinese. Therefore some of the tutors had to 
learn some Chinese words from the tutees who insisted on speaking in Chinese. 
Other tutors had to use google translate to be able to understand their tutees. In an 
indirect way, they were able to learn and improve their Chinese. These are some 
of the tutors’ reactions: 

From the online tutoring, what I learn is, I learn some Chinese words from 

the student because she use much Chinese words because she did not know 


the English. And also I learned from the other tutor besides me; because 
she is a local student here and sometimes when I don’t understand what 
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my student say, I will ask her and she will help me to translate it. (T23, 

video reflection) 

“Sometimes, I had some problem to explain something completely in English, 
because its 100% English, and I have to pick up some words in Chinese. Thanks 
to google translate which helped me a lot...” (T14, sharing forum). “Not only that 
this program has allowed me to learn about Taiwanese culture, but it also gives 
me the opportunity to improve my Chinese (thanks to Mary [not her real name] 
for teaching me Chinese)” (T16, written reflection). 

During the tutoring process, I also learn a lot. I mean, this tutoring process 

is not a one way learning process. It’s two-way. It means I learn and also 

my student also learns. So I teach her about a lot of English vocabulary, 

about general knowledge... and she also teach me some Chinese 

vocabulary.... (T13, video reflection) 
Another tutor mentioned that: 

... So I try to put more Chinese letter on the screen and I told him that we 

can share together like I will learn Chinese, he will learn English. So we 

can share together. He can check my Chinese and I can check his English. 

This may help him to feel like he is talking to a friend not just learning. 

I think that he is much more interested in the lesson.... (T29, video 

reflection) 

Essentially, as indicated by the tutors' comments, participating in the 
project gave them motivation to learn Chinese language which could have not 
happened had they not taken part in the project. Therefore, they could be able to 
communicate with the local community in their day to day interactions. 

Cultural exchange 

The tutors indicated that the online tutoring gave them a chance to learn 
about the culture of Taiwan from the tutees and teach the tutees about their own 
culture. For instance, a tutor stated “... help me to learn a lot of culture in Taiwan 
and I teach her also about the culture in Indonesia and we exchanged the culture. 
So she knows more about Indonesia and I know more about Taiwan" (T05, video 
reflection). Another tutor indicated that: 

... and the next we get the culture exchange between Indonesia and Taiwan 

to my students and in this part I also get to meet him because not only need 

support for vocabulary and grammar in English but I also can share the 

culture between Taiwan and Indonesia. (T32, video reflection) 
Evidently, the online tutoring project facilitated cultural exchange between the 
tutors and the tutees. By learning about some culture of Taiwan, they could more 
easily fit in and have harmonious interactions with the people of Taiwan even 
though they are foreigners. 
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Peer encouragement 

Through sharing about their experiences with each other in the sharing 
forums which were conducted from the fifth week where tutors were selected 
to talk about their experiences, the tutors were able to learn from and encourage 
each other, for instance, on how to improve on the way they teach their tutees, 
how to solve some of the challenges they experienced, and how to prepare 
teaching materials. Some comments from the tutors include: “And then from my 
peers, from other tutors I can learn how they taught their students” (T11, video 
reflection). “I was also inspired by my friends. Like my friends, my Taiwanese 
friends they always well prepare with everything they have very fabulous, 
PowerPoint, they always introduce in a good way, they interact with students 
well” (T14, video reflection). 

There is one colleague he is using a lot pictures and also using math or 

something to get more attention from the student. I like the idea of using 

the pictures or the math or something because the student can understand 

it. (T17, written reflection) 
“I just get some inspiration from my friends. I talk to them and I just like, yeah, 
what happened to your student and how has been going and we talked and helped 
one another some problem" (T02, written reflection). Therefore, by sharing their 
experiences, the tutors gained different perspectives from their peers to help them 
make improvements in their teaching. 

Helping tutees boost their confidence to speak English 

During the first weeks of the tutoring sessions, most of the tutors mentioned 
in their self-reflections that their tutees were shy and afraid to express themselves 
in English. Through the tutoring sessions, the tutors encouraged them to speak 
more and gave them advice on how to improve their English speaking skills. 
This involved use of varied teaching strategies like using more questions, use of 
google translate, chatting, speaking Chinese among others. As time progressed, 
as reflected in the tutors’ comments, many tutees built their confidence and were 
able to have conversations with their tutors. For instance, a tutor stated that: 

However, on the very first meeting, I was so surprised to know that she 

couldn't understand me at all. At first, I thought that maybe she can 

still understand a little bit of English but maybe she is just too shy, to 

speak English but then it was totally different than what I was expecting 

because she kept saying I don't understand... And changing the way I 

presented my materials have actually made a significant change in the way 

that I am interacting with Mary [not her real name]. She make a lot of 

improvements because she was so brave to speak English and she became 

very active during the class. (T16, video reflection) 
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Another tutor mentioned that: 


So my first experience is that it is so difficult for me to teach the Taiwanese 
children English because they don’t want to speak English too much.... 
After 15 weeks I found that my Taiwanese children is not really difficult as 
the first week I imagine. [Pause] for the last week I play games and I talk 
too much to my student that English is not really difficult and if you want 
to speak English just try to explore more. Define what you want to learn 
and go to school or make friends with foreigners. You can find some new 
words that you don't know. Just write down and use google translate to 
learn. You can improve your English. (T10, video reflection) 


Another tutor indicated further that: 


At the beginning of the online tutoring my student seems nervous and she 

didn't want to talk with me and she did not want to reply my words so she 

just remain silent. So I try to talk with them with Chinese and then she 

wanted to reply but it is only word by words. In the middle of the term she 

changed a lot, she get more excited in the tutoring and she can smile with 

me and talk many things also with me. At the end of the term she could 

understand well what I was talking about and she could reply well also. 

(T37, video reflection) 

The tutors were happy to see the progress of the tutees as time went by. It 
can be implied that the tutees being from the rural area lack much needed adult 
role models who could teach them how to solve communication problems. The 
role models not only need to teach the content but also need to model how to do 
it. This problem can be solved using technology. Although the tutees were not 
the focus of this study, the comments from the tutors indicated that the tutees also 
benefitted and learned from the online interaction with the tutors. Moreover, all 
the learning experiences were recorded and as evidenced from the videos, the 
tutees made some progress. For instance, we randomly selected five tutoring 
session videos and observed aspects like interaction between the tutors and tutees, 
tutee participation, attention, and facial expression from the first week to the 
last week. As observed in some of the videos, we noticed that during the first 
weeks, tutees appeared shy and unwilling to talk to the tutors. The tutors asked 
questions but some tutees simply answered “yes” and “no”. In some cases, the 
tutees kept calling their resident teachers to ask them what they should answer. 
In other cases, the tutees answered in Chinese. Some portrayed negative facial 
expressions most of the time and appeared not to be engaged in the session. For 
instance, in one video during the first week, a tutee was observed to be distracted 
yet it was around 30th minute in the session. The tutee was out of his seat and 
looking around. The tutor kept calling on the tutee to pay attention but. it took 
a while before the tutee could settle down. Moreover, in the first weeks, it) was 
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observed that communication between the tutors and tutees was mostly through 
text, not much of talking from the tutees side. However, as time progressed, in the 
last weeks, the tutees were noticed to be comfortable and felt much at ease. With 
time, they started to talk freely with their tutors and no longer seemed to depend 
on their resident teachers. In addition, they responded in English most of the 
time, they were more enthusiastic and participated actively during the sessions, 
payed more attention, and portrayed positive facial expressions (as shown in 
Figure 3). Thus with time, based on the observed videos, the interaction between 
tutees and tutors increased, and tutee participation and attention also improved. 
They were observed to be more on-task with the tutors than off-task as seen in 
the videos during the first weeks, and also more talkative. This implies that the 
project was not only of benefit to the international students but also benefitted the 
rural children. In fact, the tutees’ resident teachers reported that the children were 
willing to participate in the project the following semester. 


Figure3 Screen Shot Showing Tutee's Facial Expression 
During the First, Second, and Seventh Weeks 


Developing friendships and relationships 

Through the online tutoring process, the tutors developed friendships 
and relationships with their tutees which went beyond tutor-tutee relationship. 
They shared about their hobbies, likes, daily life, and school issues. Some even 
maintained the friendships after the tutoring project. Some comments from the 
tutors include: 


And then after more meetings, the online meetings, the student become 
more comfortable and then she can talk more. She even talk about her 
daily life. How she don't like some subjects in her school. How she loves 
her younger sister which in the same school with her and she. also talk 
about her interest in kebab and some of her pet mouse. She has two mice 
as her pets... From the online tutoring I felt like I get new friends, new 
sister. My student we still in contact via Facebook. Last week she just 
told me about her vacation in United States. (T23, video reflection) 


After a few weeks joining this program, I know better my student, I know 
what her hobby is, I know what her favourite food is, I know her favourite 
song because she always sing a Chinese song for me so.like 10. minutes 
before the end of the class, she sang a song, and also I teach her an English 
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song and she also could sing about that. I don’t have a good voice but I 
could teach her how to sing well. (T14, video reflection) 


At the beginning I was wondering that whether I am suitable for this 

program or not because I had not ever been an online tutor. But now I can 

say that I love this program very much. It gave us a good chance to have 

many nice Taiwanese friends consisting my student Alan, other Taiwan 

tutor, professor and supporters together with interesting international 
students. We have many unforgettable memories, from strangers to 
friends. (T10, written reflection) 
Thus, through the tutoring project, the tutees made lifetime friends who being 
adults could provide them with advice and guidance on various aspects of their 
daily life. 
Likes about the program 

The tutors also reflected on what they liked about the program and what they 
disliked about the program. According to their reflections, they liked the fact that 
they were able to make friends with the tutees and the project support team who 
were students from Taiwan. They also liked the fact that the project gave them 
a chance to get more teaching experience. Others liked the discussion sessions 
that were arranged for them to share their experiences amongst themselves. Some 
comments from the tutor reflections include: “About our program, the most 
interesting I like that we can make friends with online tutor supporter and also 
Taiwanese children... I think that is really great" (T10, video reflection). “And 
what I like, [pause], I can get more experience, yeah, that’s the thing because am a 
teacher anyway” (T02, video reflection). 

And also my most favourite part is, after teaching, we have a small 

discussion. So the group will be divided into two and we can share what 

we have learnt, what we have talked with students and if any challenges 

we found we can share so we can solve the problem together. (T14, video 

reflection) 

One tutor liked the fact that there were different topics for discussion each 
week. “What I like from this program is I like how it was arranged with various 
topics each week so we can talk about different topics each week and we can 
communicate about that" (T23, video reflection). 

From the online tutoring, the tutors acquired new friends from a foreign 
country. This gave them a stronger sense of belonging. They also had an 
opportunity to learn from their peers and improve on their own skills. 

Dislikes about the program 

Most of the tutors disliked the technical challenges they experienced. and 

some did not like the fact that their students had basic English skills as this made 
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them to take more time to prepare the teaching materials. Some reactions from 
the tutors include: “And, [pause] I think if I have to say something I dislike 
about the online tutoring maybe it’s just some technical problems only” (TOI, 
video reflection). Tutor T23 “Something I don’t like from this program is maybe 
because it is an online tutoring sometimes we have a problem with the connection 
but it is not really a problem (T23, video reflection)”. 

I think the part that I get a student that cannot speak English at all. 

Because of the problem I need to prepare my presentation slides like I 

need to take a lot of time to prepare it sometimes two days is not enough 

because yeah I need to take the idea then to translate it and write down 

itself is like almost a lot of time wasted. (T17, video reflection) 

From the tutors’ reactions, the major challenges faced were technical 
challenges like poor internet connection which inconvenienced their interaction 
with the tutees sometimes. 

Challenges of online tutoring 

From the tutors’ reflections, various challenges were identified including: 
technical difficulties, language barrier, inattentive tutees, and tutee absenteeism. 

For the technical challenges, most tutors indicated that they faced 
problems with the Internet speed and poor connection which resulted to frequent 
interruptions in the video connection. As a result, they had to rely on using 
the chatting feature to communicate with the tutee. Other tutors had problems 
with the Internet breakdown which made it impossible for the tutoring session 
to be held sometimes. Most tutors indicated that the poor Internet connection 
was mostly from the tutees side. The tutors expressed frustration that due to the 
Internet problem, they wasted time waiting for the problem to be solved and they 
were never sure whether they would have the tutoring session or not. One tutee 
commented that: 

During the middle of the term, because of the connection error and 

sometimes because of the Internet breakdown, so we could not meet much. 

This is a pity because I wanted to meet my student every week to talk with 

her and to help her... so to me is a challenge because you are not always so 

sure about what is going to happen during the tutoring session. (T09, video 

reflection) 

Language barrier was a challenge because some tutors could only understand 
English, although some could understand basic Chinese, and the tutees insisted 
on speaking in Chinese although they had basic levels of English. As a result of 
the language barrier, there were problems in effective communication, interaction, 
and understanding between the tutors and tutees. Other challenges included 
inattentive tutees who were easily distracted and bored during the tutoring 
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sessions and tutees who missed to attend some tutoring sessions. These occurred 
majorly due to the tutees lack of confidence in speaking in English. One tutor 
mentioned “My student also really easy to get distracted, for example, I put a 
picture he will pay more attention to the picture rather than the material itself. 
And he likes to draw on the screen” (T04, video reflection). Another tutor stated 
“sometimes my student is distractive and I know that I have to make my lessons 
more interesting and attractive” (T10, written reflection). Tutor T17 “... because I 
cannot interact with her sometimes when she gets bored I cannot ask her to focus 
onto the class...” (T17, video reflection). A tutor mentioned “My student ever 
escape from class once. I think because I ask her in English every time and her 
English speaking ability is poor" (T15, written reflection). 

The technical problems and language barrier could have contributed to a not 
so effective exchange for some tutors and tutees as they contributed to ineffective 
use of time. Also, since the tutees are not used to communicating using English 
and not used to online learning, for most of them they felt like the online tutoring 
environment was threatening to them. 

Overall experience 

Overall, the tutors expressed that they had a good experience during the 
online tutoring, they learnt especially how to teach online, and teach children, had 
fun, and expressed that the opportunity to teach online helped them enhance their 
job skills. They also obtained valuable communication skills. For instance, a 
tutor stated that: 

I think it's fun it's really good experience for me because actually I never 

teach someone before. This is my first time teaching children. Jane [not 

her real name] is my first student ever. And from this program I think it 

is really fun. Every week is really fun. I can teach her and sometimes I 

get more knowledge from her, I can learn from her and it also make me 

get more skills for communicating with others... overall it is really fun 

experience. (T22, written reflection) 

Tutor TO2 mentioned that “Overall, I had a novel, good, exciting experience in 
teaching digitally. This will be definitely beneficial to my career" (T02, written 
reflection). 

Based on the responses of the tutors, the DLC project was beneficial to the 
tutors since it provided them with an opportunity to acquire job experience and 
skills such as online teaching skills which could make them competitive in their 
job search. They also acquired more intercultural communication skills. 


Cultural Awareness 
The project helped the tutors to develop cultural awareness about Taiwan by 
exchanging their country's culture with the tutees as they learnt about the, culture 
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of Taiwan from them. The tutors appreciated the opportunity that the project gave 
them to learn more about Taiwan. The objective of cultural exchange was fulfilled 
by having the tutors and tutees share information about their countries with each 
other about the following topics; food, housing, clothing, entertainment, famous 
scenery, and transportation. For instance, a tutor mentioned that: 
So I teach her about a lot of English vocabulary, about general knowledge 
and more importantly about the culture. Like my culture and also the 
culture around the world and she also teach me some Chinese vocabulary 
and about the culture in Taiwan. So this program is really useful for 
everyone. (T13, video reflection) 
Another tutor stated: 
With my lessons, [pause] we have learnt a lot from each other. I have 
learnt a lot from Taiwanese student. Special thing consisting of first 
traditional, cultural, and something like that and I teach Alan a lot of 
special thing in Vietnam. (T10, video reflection) 
Some of the cultural aspects learned are discussed below. 
Similarities and differences in cultures, and way of life 
The tutors also learnt about the similarities and differences in their culture 
and that of Taiwan. For instance, a tutor indicated that: 
And with joining this program, I can learn also about the Taiwanese 
people, Taiwanese culture and even there is some difference in our culture 
between Taiwanese culture and Indonesian culture such as housing, 
clothing, transportation, and also about the taste of the food is a little 
bit different but in general is a lot of common thing, the same between 
Taiwanese and Indonesian culture. And everything in this experience is 
enrichment my awareness about Taiwanese culture about the different 
culture between Taiwan culture and also Indonesian culture. (T27, video 
reflection) 
Other reactions from tutors are: “From this program I found that we have many 
similar culture between Vietnam and Taiwan but also different" (T10, video 
reflection). “I have myself learnt a lot of things about what are the similarities and 
differences about both the cultures and about the places and about the clothes" (TO6, 
video reflection). 
Some tutors and tutees shared about their personal lives through the cultural 
exchange. For instance, Tutor T02 mentioned that: 
... and for me it was about the culture awareness. I learn about how 
they like to eat in the morning. Like the student they don't like any 
international food at all. They just like local ones like noodles, rice, and 
other things they don’t like.... (T02, written reflection) 


Thus, the DLC project helped the tutors to increase their awareness about 
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their similarities and differences between their cultures and the culture of Taiwan 
and the people of Taiwan. Their knowledge of Taiwan culture also increased. 
Challenging of stereotypes 

Through the cultural exchange, some tutors changed their negative 
perceptions and conclusions they had formed about issues like food in Taiwan. 
For instance, a tutor mentioned that: 


[Pause] about the culture. Ah... honestly before the online tutoring 
everything about Taiwan, Taiwanese people or Taiwanese culture, I just 
look the people, the Taiwanese people. The action they do around the 
NTUST campus only. But now with the online tutoring, of course, I have 
chance to know the people, the culture from other area of Taiwan. ... Ah... 
of course the difference, from Vietnam my country and Taiwan of course 
have some difference. The food as well, ah... honestly when I come here, I 
can’t familiar with the food here. It’s too sweet and a lot of oil and I don’t 
like it and sometime I think like, yeah, it’s very hard to eat. But my friend, 
my Taiwanese friend already recommend me a lot of famous food here and 
I think that a lot of food I never taste so I need to taste more before I come 
to the final conclusion about food in Taiwan. (T1, video reflection) 
Through the online tutoring, the tutors could become more open-minded toward 
the culture of Taiwan. 
Other cultural aspects 
Apart from exchanging culture based on the topics provided, some tutors 
also observed some cultural differences in education between their country and 
Taiwan. For instance, a tutor stated that: 
Students are also very respectful to the teacher, [pause] oh but one thing, 
I feel that my student is sometimes more active than the student in my 
country because sometimes we have small talk about her daily life. 
She spent part of her week playing some sport. I don’t think it’s really 
common for Vietnamese student. That’s a good point for Taiwanese 
student. To develop themselves in terms of mentality and physicality. (T03, 
video reflection) 
Another tutor also made a similar comment: 
So in the cultural aspect, I think Indonesia and Taiwan have slightly 
different culture especially education. Here in Taiwan I see that the student 
do many things in the school and in the evening time but Indonesia we go 
back from school way sooner than in Taiwan. (T25, video reflection) 
Although language barrier was a hindrance to effective cultural exchange, 
some tutors tried to overcome the language barrier by learning some Chinese 
words to be able to communicate with their tutee. As one tutor stated: 


One interesting thing that I learned from this online tutoring. program is 
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that this program has actually helped me to make me realize that you can 

actually still share your country’s culture and learn about other country’s 

culture even though there is a language barrier. So, I think that the 

language barrier has brought us closer actually because she realized that I 

am very confident enough to talk in Chinese even my Chinese is poor and 

with that in mind I think it helps her to build her confidence too so that 

she can [pause] briefly speak English even though she knows that she will 

make some mistakes most importantly in the pronunciations. But, [pause] 

she knows that both of us are still trying to learn a new language and it’s 

hard and so it’s okay to make mistakes. And that actually what makes her 

feeling more comfortable and more confident to talk English in front of me. 

(T16, video reflection) 

Since none of the international students was a native speaker of English, or could 
speak Chinese fluently yet communicated in both languages confidently, this 
encouraged the tutees to speak up more. 

The DLC project was useful in facilitating cultural exchange as evidenced 
by comments from the participants. Some of the comments show that through the 
cultural exchange, the stereotypes the some of the tutors had about Taiwan were 
challenged. Some tutors were more willing to self-disclose information about 
their personal lives. This could have been easier because of using the online 
environment. They even observed cultural differences beyond the topics assigned 
meaning they appreciated the usefulness of the project. 


Discussion 

Tutoring Experiences 

This study describes international students’ experiences in an online tutoring 
project, and effectiveness of the online tutoring program for the development of 
cultural awareness. The findings indicate that the international students learnt 
not only how to teach generally but also how to teach online despite the fact that 
most of them were not training to be teachers. The results showed that the tutors 
considered the online tutoring project beneficial for acquiring and improving 
on teaching skills (both online and teaching in general), language learning, peer 
encouragement, cultural exchange, helping tutees make boost their confidence to 
speak English and developing friendships and relationships with the tutees, with 
other tutors and with the project support team who were students from Taiwan. In 
Cifuentes and Shih’s (2001) study, similar results were obtained after an e-mail 
correspondence partnership was conducted between American preservice teachers 
and Taiwanese university students to prepare the preservice, teachers for online 
teaching and learning. The online teaching experiences provided the preservice 
teachers with online teaching experience, time for individualized instruction, 
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authentic language learning and cultural exchange (Cifuentes & Shih, 2001). Our 
results also confirm ChanLin, Lin, and Lu’s (2012) conclusion that the online 
tutoring experience provided the university students with an opportunity to build 
friendships with the learners in remote areas. The students were also more willing 
to make adjustments according to their learners’ needs since the tutoring provided 
them with an opportunity to have an experience in a socio-cultural diverse setting 
(ChanLin et al., 2012). 

Although some of the tutors in this program were not trainee teachers, the 
focus of the project was cultural exchange and not formal teaching, and thus their 
lack of pedagogical skills could not impede their engagement with the tutees 
in terms of sharing culture. Hence the approach taken in this project can be 
scaled and replicated as deemed appropriate. Since some of the tutors were not 
training to be teachers, we provided them with some basic training on knowledge 
sharing such as preparation for the lesson prior to them engaging with the tutees. 
As this project was founded, organized, and administered by a teacher training 
centre, we have the knowledge and background on how to train trainee teachers. 
Therefore, based on the findings, this model could be effective for future cultural 
exchange programs. This is a social action project which aims to create a social 
impact to the community. As a start, we provide some opportunities to the 
international students with the hope that with time, they will encourage others 
to join. By including other students, we try to attract many participants so that 
we can encourage more potential people to this field and also increase their 
awareness of social responsibility. To overcome the digital divide and some of 
the challenges experienced by the rural students such as having few qualified 
teachers, we also recommend the use of online teaching for formal learning but so 
as not to compromise the quality of online teaching for the rural school children, 
we suggest that Taiwanese trainee teachers are paired with the rural elementary 
school children. 

While this research focussed on the experiences of tutors, we appreciate 
that tutee experiences could as well have been worth exploration in relation to 
evaluating the success of the project. As this has already been explored in the 
recent past by studies such as Cheng et al., (2007), we dedicated this paper to 
the experience of tutors. In the follow-up study, we hope to investigate tutees’ 
experience among other parameters for the sake of informing design of tutee 
centric online tutoring platform that facilitates cultural awareness and cultural 
exchange from the tutees perspective. 


Cultural Awareness 
The results indicated that the DLC project provided an opportunity for the 
international students to learn about the culture of Taiwan: In their reflections; 
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the tutors indicated that the project was useful for them since it gave them an 
opportunity to learn about the people of Taiwan and their culture. This in turn 
made them to appreciate their own culture more, which some of them had 
ignored. The project was also useful for the rural children to learn about and 
be exposed to other cultures since they have few opportunities to experience 
other cultures. Through the exchange, the tutors learnt about the similarities 
between their cultures and the culture of Taiwan based on the given topics. This 
confirms Angelova and Zhao’s (2015) claim that learning about other cultures 
provokes awareness of one’s own culture and conclusion that computer-mediated 
communication tools are useful for learning about a target culture. Most of the 
tutors mentioned that they would like to participate in the DLC project again in 
future. However, they indicated that they would like to be paired with students 
who could be able to communicate in English. This result also confirms Zeiss and 
Isabelli-Garcia’s (2005) suggestion that the Internet can be suitably employed to 
implement culture-based activities. 


Effectiveness of Technology Use 

Although most tutors indicated that they faced the challenge of language 
barrier since their tutees were either shy to speak in English or had low English 
speaking ability, through the use of technology, they were able to navigate through 
this challenge. By the end of the program, they mentioned in their reflections 
that they employed various strategies such as use of google translate to be able 
to communicate with their tutees. Some even mentioned that their tutees got 
motivated to speak in English when they realized their tutors were trying to use 
Chinese even though they did not know any Chinese before taking part in the 
project. This implies that language barrier is not a challenge to effective online 
tutoring and cultural exchange. Through application of technology, some of the 
challenges faced in traditional tutoring settings may be overcome. As ChanLin et 
al. (2012) concluded, through interacting with students who had a different culture 
from theirs, the tutors learnt to deal with real-life problems such as the language 
barrier issue which could hamper effective communication and interaction. None 
of the tutors dropped out of the project due to the language issue instead as noted 
earlier, they looked for ways to overcome this problem using technology. 


Recommendations for Future Projects 

Based on statements made by the tutors and our own observations, the 
following suggestions are recommended for similar projects in future: 

1. Try as much as possible to avoid technical challenges due to Internet 
speed and connection to ensure a smooth interaction between the tutors and. tutees 
hence avoid frustration. Although this may not be possible because it a limitation 
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in the rural area. Therefore, we recommend that the tutors be made aware of the 
problem and prepare for the challenge. 

2. Pair tutors with tutees who could speak English for effective communication 
and interaction so that tutors do not feel overburdened when preparing teaching 
materials and tutees do not become uncomfortable since they feel they cannot 
communicate. Since most tutees levels of English are low, we recommend 
providing tutors with adequate background information about the tutees they will 
be interacting with, for instance, their English speaking ability so that they do not 
get frustrated when they face challenges like communication problems during the 
tutoring sessions. We also recommend that special training be provided to the 
tutors regarding how to communicate with people who have low communication 
abilities. 

3. Communication from the tutee’s side in advance in the event that a tutee 
will be absent for a given session so as to avoid causing frustration for tutors who 
take time to prepare for a session only for the student not to show up. Therefore, 
we recommend that the teachers from the tutees side be more proactive. 

4. Teachers of the tutees should encourage them to be active participants in 
the tutoring sessions, for instance, ask questions and respond to questions raised 
by their tutors, actively participate in other activities conducted during the tutoring 
sessions and use this rare opportunity to practice their English speaking skills in 
order to improve. 

5. Alternatively, to encourage tutee active participation, make the exchange 
to account for a part of their grade. 


Conclusion 

This study aimed to contribute to the emerging literature on online teaching 
and learning experiences and on the use of online tutoring to facilitate cultural 
exchange. The findings indicated that participants enjoyed the tutoring experience 
and gained some skills on how to tutor online. They also gained some benefits 
such as being able to make friends with the tutees, learn some Chinese from the 
tutees, and learn about the culture of Taiwan from the tutees. Since they also 
shared about their culture to the tutees, they were able to appreciate their culture 
more. Our study demonstrates that although we have other ways of learning 
about culture, we could leverage the advantages of the Internet and technology to 
shorten distance and costs to learn about the culture of a people. 

One limitation of the study is the small number of participants (n = 39) and 
they all came from one university. Therefore, the results may not be generalizable 
to larger populations and to international students in other universities. Future 
studies may benefit from having more participants and including international 
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students from various universities in Taiwan. A second limitation is that the study 
was conducted for only one semester. In future, we recommend that longitudinal 
studies be conducted to clearly assess and understand the role of online tutoring 
in facilitating cultural learning. A third limitation is that the tutors used in this 
project were not training to be teachers therefore their experiences may only 
be generalized to participants with similar backgrounds. Future studies may 
benefit from using trainee teachers as participants so that the results could be 
used to improve on the growth of the teachers in online teaching and learning 
settings. A fourth limitation is that only tutor experiences and cultural awareness 
were assessed. Future studies could assess both tutor and tutee experiences and 
cultural awareness to evaluate if the project is effective for the tutees too. We also 
recommend further research to assess whether such programs could be useful and 
effective beyond the educational setting. 

A pedagogical implication of the study is that because the international 
students appreciated the opportunity given by the project to learn culture, 
universities and schools could incorporate such online tutoring projects especially 
for new international students to help them learn about and get exposed to the 
culture of the country they are studying in so that they can easily adapt to the 
culture. They could also use such projects for learning the local language. For the 
local schools, the students could use this opportunity to get an exposure to other 
cultures around the world in the comfort of their country. A second pedagogical 
implication is that, although the findings are applicable only to the situation the 
study examined, they may be used to improve on other similar situations which 
involve interaction of people from different cultures in an online teaching setting. 
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